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(57) Abstract: The present invention relates to digital watermarking. In a preferred embod- 
iment, a media signal (12) is embedded with a digital watermark component. The media 
signal includes a cyan color plane, a magenta color plane, a yellow color plane, and a black 
color planes. The digital watermark component is inverted, and embedded in the the black 
color plane (1 12). The embedding of the black plane is spatially aligned with the embed- 
ding of the cyan, magenta and yellow planes (1 14). The resulting watermark is fragile, since 
signal processing techniques that combine the color planes with the black color plane effec- 
tively cancels the watermark signal in localized areas. The inventive watermark also includes 
low-visibility properties, since the watermark signal cancels perceived luminance changes in 
local areas throughout the media signal. 
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HIDING INFORMATION OUT-OF-PHASE IN COLOR CHANNELS 

Related Application Data 
[0001] This application is related to the following U.S. Patent Applications: 
09/898,901, filed July 2, 2001; 09/933,863, filed August 20, 2001; 09/945,243, filed 
August 31, 2001 ; 10/1 15,441, filed April 2, 2002; 10/1 15,444, filed April 2, 2002; and 
10/1 15,582, filed April 2, 2002. Priority is claimed to each of these applications. 

Field of the Invention 
[0002J The present invention relates to digital watermarking and steganographically 
hiding data. 

Background and Summary of the Invention 
[0003] The present application discloses novel and inventive digital watermarking 
techniques and related applications. 

[0004] Digital watermarking technology, a form of steganography, encompasses a 
great variety of techniques by which plural bits of digital data are hidden in some other 
object, preferably without leaving human-apparent evidence of alteration. 

|0005] Digital watermarking may be used to modify media content to embed a 
machine-readable code into the media content. The media may be modified such that 
the embedded code is imperceptible or nearly imperceptible to the user, yet may be 
detected through an automated detection process. 

[0006] Digital watermarking systems typically have two primary components: an 
embedding component that embeds the watermark in the media content, and a reading 
component that detects and reads the embedded watermark. The embedding 
component embeds a watermark pattern by altering data samples of the media content. 
The reading component analyzes content to detect whether a digital watermark is 
present. In applications where the watermark encodes information, the reading 
component extracts this information from the detected watermark. Assignee's U.S. 
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Patent Application No. 09/503,881, filed February 14, 2000, discloses various encoding 
and decoding techniques. United States Patent Nos. 5,862,260 and 6,122,403 disclose 
still others. 

[0007] One form of digital watermark is a so-called "fragile" watermark. A fragile 
watermark is designed to be lost, or to degrade predictably, when the data set into 
which it is embedded is processed in some manner, such as signal processing, 
scanning/printing, etc. A watermark may be made fragile in numerous ways. One 
form of fragility relies on low watermark amplitude. That is, the strength of the 
watermark is only marginally above the minimum needed for detection. If any 
significant fraction of the signal is lost, as typically occurs in photocopying operations, 
the watermark becomes unreadable. Another form of fragility relies on the 
watermark's frequency spectrum. High frequencies are typically attenuated in the 
various sampling operations associated with digital scanning and printing. Even a high 
amplitude watermark signal can be significantly impaired, and rendered unreadable, by 
such photocopying operations. 

[0008] According to one aspect of the present invention, we hide data out-of-phase 
with respect to at least two color channels. Sometimes we use the term "inverted'* 
instead of the term "out-of-phase." A watermark signal in one color plane (or channel) 
is applied to be out-of-phase with a corresponding watermark signals in another color 
plane(s) or channel(s). Basically, if we embed a positive signal at a first image location 
in a first color channels (e.g., by changing the first color channel's color level or 
luminance attributes) we then embed a corresponding negative signal at the first image 
location in a second color channel (e.g., black color channel). An effect of our 
inventive out-of-phase watermarking technique is to greatly reduce watermark visibility 
by canceling perceived luminance change in local areas throughout the image. The 
disclosed watermark is also fragile, since signal-processing operations that combine the 
out-of-phase color channel with the other channels cancels the watermark signal. 

[0009] Nevertheless, we disclose several detection methods that are suitably tailored 
to detect our out-of-phase digital watermark. 
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[001 0] According to another aspect of the present invention, our out-of-phase 
watermark includes at least a first component and a second component The second 
component is embedded so as to be out-of-phase with respect to the first component. In 
one implementation, the first component is printed with a first ultraviolet (UV) ink and 
the second component is printed with a second UV ink. The first UV ink preferably 
includes a shorter decay time in comparison to the second UV ink. The out-of-phase 
watermark has low visibility properties since, under steady-state UV illumination, the 
illuminating properties of the first and second watermark components cancel each 
other. Other embodiments involve unique detection methods for a UV out-of-phase 
digital watermark. 

[001 1 J The foregoing and other aspects, features and advantages of the present 
invention will be even more apparent from the following detailed description, which 
proceeds with reference to the accompanying drawings. 

Brief Description of the Drawings 

[001 2] FIG. 1 is a diagram of a color space depicting how to scale a color vector to 
black to effect a change in luminance. 

[0013] FIG. 2 is a diagram of a color space depicting how to scale a color vector to 
white to effect a change in luminance. 

[0014] FIG. 3a is a diagram illustrating cyan (C), magenta (M), yellow (Y) and black 
(K) channels. 

[0015] FIG. 3b illustrates the CMYK channels of FIG. 3a, embedded with 
information. 

[0016] FIG. 4 is a flow diagram illustrating an out-of-phase embedding process. 
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[001 7) FIG. 5 illustrates hiding an image in media. 

[0018] FIG. 6 is a flow diagram illustrating an embedding method according to one 
implementation of the present invention. 

[0019] FIG. 7 and 8 are graphs showing hidden signal strength in terms of luminance. 

[0020] FIGS. 9 and 10 are graphs showing hidden signal strength in terms of color 
saturation. 

[0021] FIG. 1 1 illustrates limiting a signal tweak in low CMY areas to reduce hidden 
signal visibility. 

[0022] FIG. 12 illustrates the segmentation of media into blocks. 

[0023] FIG. 13 illustrates a feedback loop in an embedding process. 

[0024] FIG. 14 illustrates feedback for the FIG. 13 feedback loop. 

[0025] FIGS. 1 5a and 1 5b illustrate detection apparatus. 

[0026] FIGS. 16 and 1 7 are diagrams showing obtaining luminance values. 

[0027] FIG. 1 8 is a flow diagram illustrating a detection method. 

[0028] FIG. 19 is a flow diagram illustrating a detection method of data in a red (R), 
green (G) and blue (B) color space. 

[0029j FIG. 20 illustrates approximating a color saturation value in an RGB color 
space. 
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[0030] FIGS. 21 and 22 are diagrams illustrating relative threshold values for the 
method shown in FIG. 1 9. 

(0031) FIG. 23 is a flow diagram illustrating a luminance collection method 
according to the present invention. 

[0032] FIG. 24 illustrates orientation fiducials hidden in a media signal with our out- 
of-phase embedding techniques. 

[00331 FIG. 25 illustrates out-of-phase embedding of a spot color. 
[0034] FIG. 26 illustrates a printer calibration process. 

[0035] FIG. 27 is diagram showing a baseline signal, the baseline signal embedded 
with a digital watermark signal, and the baseline signal embedded with an inverted 
digital watermark signal. 

[0036] FIG. 28a is a graph showing a signal with a relatively short fluorescence decay 
time. 

|0037] FIG. 28b is a graph showing a signal with a relatively longer fluorescence 
decay time. 

[0038] FIG. 29 illustrates relative timing for a UV pulse. 

(0039] FIG. 30 is a graph showing relative decay times and camera gating timing in 
relation to the signals shown in FIGS. 28a, 28b and 29. 

[0040] FIG. 31 is a diagram illustrating color data embedded with an out-of-phase 
digital watermark. 
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[0041] FIGS. 32a and 32b respectively illustrate image capture of an out-of-phase 
digital watermark and camera synchronization. 

(0042] FIG. 33 illustrates an ultraviolet detection apparatus. 

[0043] FIG. 34 illustrates relative timing for a series of UV pulses. 

[0044] FIG. 35 is a graph showing relative decay times and camera gating timing in 
relation to the signals shown in FIGS. 28a, 28b and 34. 

[0045] FIG. 36 is a diagram illustrating RGB and CMY common color gamuts, and 
out-of-gamut colors. 

Detailed Description 

General Watermarking Introduction 

[0046] A watermark can be viewed as an information signal that is embedded in a 
host signal, such as an image, audio, video or some other media content. Watermarking 
systems typically include the following components: 1 ) an embedder that inserts a 
watermark signal in the host signal to form a combined signal; 2) a detector that 
determines the presence and orientation of a watermark in a potentially corrupted 
version of the combined signal; and 3) a reader that extracts a watermark message from 
the combined signal. In some implementations, the detector and reader are combined. 

[0047] To encode a message, the watermark encoder analyzes and selectively adjusts 
the host signal to give it attributes that correspond to a desired message symbol or 
symbols to be encoded. There are many signal attributes that may encode a message 
symbol, such as a positive or negative polarity of signal samples or a set of samples, a 
given parity (odd or even), a given difference value or polarity of the difference 
between signal samples (e.g., a difference between selected spatial intensity values or 
transform coefficients), a given distance value between watermarks, a given phase or 
phase offset between different watermark components, a modulation of the phase of the 
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host signal, a modulation of frequency coefficients of the host signal, a given frequency 
pattern, a given quantizer (e.g., in Quantization Index Modulation), etc. 

[0048] The structure and complexity of a watermark signal can vary significantly, 
depending on the application. For example, the watermark may be comprised of one or 
more signal components, each defined in the same or different domains. Each 
component may perform one or more functions. Two primary functions include acting 
as an identifier to facilitate detection and acting as an information carrier to convey a 
message. In addition, components may be located in different spatial or temporal 
portions of the host signal, and may carry the same or different messages. 

[0049] The host signal can vary as well. The host is typically some form of multi- 
dimensional media signal, such as an image, audio sequence or video sequence. In the 
digital domain, each of these media types is represented as a multi-dimensional array of 
discrete samples. For example, a color image has spatial dimensions (e.g., its 
horizontal and vertical components), and color space dimensions (e.g., CMYK, YUV or 
RGB). Some signals, like video, have spatial and temporal dimensions. Depending on 
the needs of a particular application, the embedder may insert a watermark signal that 
exists in one or more of these dimensions. 

[0050] In the design of the watermark and its components, developers are faced with 
several design issues such as: the extent to which the mark is impervious to jamming 
and manipulation (either intentional or unintentional); the extent of imperceptibility; the 
quantity of information content; the extent to which the mark facilitates detection and 
recovery, and the extent to which the information content can be recovered accurately. 

[0051] For certain applications, such as copy protection or authentication, the 
watermark should be difficult to tamper with or remove by those seeking to circumvent 
it. To be robust, the watermark should withstand routine manipulation, such as data 
compression, copying, linear transformation, flipping, inversion, etc., and intentional 
manipulation intended to remove the mark or make it undetectable. Some applications 
require the watermark signal to remain robust through digital to analog conversion 
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(e.g., printing an image or playing music), and analog to digital conversion (e.g., 
scanning the image or digitally sampling the music). In some cases, it is beneficial for 
the watermarking technique to withstand repeated watermarking. 

[0052] For other applications, such as forensic tracking, counterfeit detection, etc., 
the watermark should degrade predictably under routine manipulation. Such 
watermarks are refereed to generally as "fragile" watermarks, as discussed above. 

[0053] A variety of signal processing techniques may be applied to address some or 
all of these design considerations. One such technique is referred to as spreading. 
Sometimes categorized as a spread spectrum technique, spreading is a way to distribute 
a message into a number of components (chips), which together make up the entire 
message. Spreading makes the mark more impervious to jamming and manipulation, 
and makes it less perceptible. 

[0054] Another category of signal processing technique is error correction and 
detection coding. Error correction coding is useful to reconstruct the message 
accurately from the watermark signal. Error detection coding enables the decoder to 
determine when the extracted message has an error. 

[0055] Another signal processing technique that is useful in watermark coding is 
called scattering. Scattering is a method of distributing the message or its components 
among an array of locations in a particular transform domain, such as a spatial domain 
or a spatial frequency domain. Like spreading, scattering makes the watermark less 
perceptible and more impervious to manipulation. 

[0056] Yet another signal processing technique is gain control. Gain control is used 
to adjust the intensity of the watermark signal. The intensity of the signal impacts a 
number of aspects of watermark coding, including its perceptibility to the ordinary 
observer, and the ability to detect the mark and accurately recover the message from it. 
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(0057] Gain control can impact the various functions and components of the 
watermark differently. Thus, in some cases, it is useful to control the gain while taking 
into account its impact on the message and orientation functions of the watermark or its 
components. For example, in a watermark system described below, the embedder 
calculates a different gain for orientation and message components of an image 
watermark. 

[0058| Another useful tool in watermark embedding and reading is perceptual 
analysis. Perceptual analysis refers generally to techniques for evaluating signal 
properties based on the extent to which those properties are (or are likely to be) 
perceptible to humans (e.g., listeners or viewers of the media content). A watermark 
embedder can take advantage of a Human Visual System (HVS) model to determine 
where to place an image watermark and how to control the intensity of the watermark 
so that chances of accurately recovering the watermark are enhanced, resistance to 
tampering is increased, and perceptibility of the watermark is reduced. Similarly, audio 
watermark embedder can take advantage of a Human Auditory System model to 
determine how to encode an audio watermark in an audio signal to reduce audibility. 
Such perceptual analysis can play an integral role in gain control because it helps 
indicate how the gain can be adjusted relative to the impact on the perceptibility of the 
mark. Perceptual analysis can also play an integral role in locating the watermark in a 
host signal. For example, one might design the embedder to hide a watermark in 
portions of a host signal that are more likely to mask the mark from human perception. 

[0059j Various forms of statistical analyses may be performed on a signal to identify 
places to locate the watermark, and to identify places where to extract the watermark. 
For example, a statistical analysis can identify portions of a host image that have noise- 
like properties that are likely to make recovery of the watermark signal difficult. 
Similarly, statistical analyses may be used to characterize the host signal to determine 
where to locate the watermark. 

[0060] Each of the techniques may be used alone, in various combinations, and in 
combination with other signal processing techniques. 
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[0061] to addition to selecting the appropriate signal processing techniques, the 
developer is faced with other design considerations. One consideration is the nature 
and format of the media content. In the case of digital images, for example, the image 
data is typically represented as an array of image samples. Color images are 
represented as an array of color vectors in a color space, such as RGB or YUV. The 
watermark may be embedded in one or more of the color components of an image. In 
some implementations, the embedder may transform the input image into a target color 
space, and then proceed with the embedding process in that color space. 

Color Image Processing 

[0062] In image processing applications, it is sometimes useful to be able to change 
the colors of an image while reducing the visibility of these changes. Image 
watermarking is one application where it is desirable to alter image samples to encode 
information in a manner that is readily recoverable by an automated process, yet 
substantially imperceptible to human visual perception. Often, the aim of watermark 
encoding is to maximize a watermark signal without significantly affecting image 
quality. Since the eye is more sensitive to changes in memory colors such as flesh 
tones or blue sky, it is beneficial to have a method of selectively controlling strength of 
a watermark in certain color regions. 

[0063] to one implementation, a watermark encodes auxiliary information in an 
image by making changes to image samples. A color-masking framework maps a 
change in an image sample attribute to an equivalent yet less perceptible change in the 
color values of that image sample. This mapping can be used to obtain equal 
perceptual watermark changes to image samples in other areas of color space and to 
apply the change in the least visible color channels. 

|00641 While the implementation details of watermark encoding schemes vary 
significantly, a class of watermarking schemes can be modeled as an array of changes 
to luminance values of a host image. The host image comprises an array of color 
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vectors (e.g., an array of color such as RGB, CM Y, CMYK, etc). The image sample 
may be represented as a vector between black and the pixel color value. To encode a 
watermark, the luminance of the image sample may be increased or decreased as shown 
in FIG. 1 . FIG. 1 shows a 3-dimensional color space with Cyan (C), Magenta (M) and 
Yellow (Y) axes. The bold axis between black and white represents luminance. To 
make an equivalent luminance change in an image sample of a given color vector (CI, 
Ml, Yl), one may make a corresponding scale to black as shown. 

(0065] An alternative method of obtaining the same luminance change is to scale the 
image sample like a vector between white and the sample's color value as shown in 
FIG. 2. To make an equivalent luminance change, one may make a corresponding 
scale to white as shown. 

[0066] By using the scale to white method for colors with high yellow content such as 
yellow, red and green, and scale to black for blue, cyan and magenta a lower visibility 
watermark can be encoded with the same detectability. 

[0067] Once the color vector entries are established, each of the entries is associated 
with a set of scale factors. The set includes a scale factor for each color component. 
The specific color components in the implementation depend on the color format of the 
image. For example, images in an RGB format have scale factors for each of the R, G 
and B color components. Similarly, images in a CMY format have scale factors for 
each of the C, M and Y components of each table entry. The scale factors for each 
entry are derived by rewriting the above mathematical expression and solving for each 
color's scale factor as a function of the known color component values. 

Redundant Color Properties 

[0068] Three-color components, such as Red, Green, Blue (RGB) or Luminance, 
color component "a" and color component "b" (L*a*b), can be combined to uniquely 
identify a particular color. In many cases, more than three-color components can be 
combined to specify (or approximate) the same particular color. Typically, four (4) 
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color components, e.g., cyan, magenta, yellow and black (CMYK) are used in printing 
processes. Extra colors, sometimes referred to as "spot colors/* can be added for more 
accurate color reproduction. A company logo, might include a particular shade of 
green, which is printed with a corresponding green ink (e.g., a green spot color). High 
fidelity color printing often uses more than four (4) color components. These 
additional color components expand the gamut of printing colors for very high quality 
printing, such as fine art reproduction. Security printing (e.g., bank notes, financial 
documents, certificates, etc.) also uses a plurality of inks, with fine lines, such as 
intaglio. 

[0069] Printing processes with more than three (3) inks (or color component 
dimensions) have a built-in redundancy, since more than three (3) color components 
(e.g., CMYK) are used to specify a color at a particular point in an image. This implies 
that many different combinations of four (4) or more printing inks (or components) can 
be used to represent a three (3)-component color. By way of example, a point in the 
CMY color space (e.g., 61% cyan, 50% magenta, and 48% yellow) can be represented 
(or approximated) by a corresponding point in the CMYK color space (e.g., 51% cyan, 
40% magenta, 38% yellow, and 22% black). Respective color levels can be generated 
from relative percentages. This same 3-channel color point can also be represented in 
the CMYK color space as 32% cyan, 23% magenta, 22% yellow, and 43% black. Of 
course, this is but one of many possible color combinations. We can utilize this color 
redundancy to reduce the human visibility of a digital watermark. For example, a 
watermark signal in one color channel, can be effectively counteracted (e.g., cancelled) 
in the other color (or black) channels, while still obtaining the desired color. 

[0070J Our inventive techniques, discussed below, can be used to provide a fragile 
watermark. The watermark's fragility is due, at least in part, to its small-scale spatial 
variation within a media signal, making the watermark ideal to combat typical 
counterfeiting operations such as scanning/printing, digital manipulation and 
photocopying. Of course, the process described for "CMYK" media below, could also 
be applied in a similar manner to other multi-color plane printing processes. 
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Low Visibility Watermarks Using Out-of-Phase Color Embedding 

[0071] Media is embedded with a watermark signal. Of course, the media may 
correspond to an image, digital image, photograph, video frame, graphic, etc., and in 
some cases, may even include a physical object such as a document, banknote, postage 
stamp, etc. Typically, a watermark signal has at least one component, which when 
embedded in the media corresponds to (or affects) various areas or pixels in the media. 
In the case of an area (or pixel) represented in a color space, the watermark signal 
component can be added to or subtracted from the color value of the area (or pixel) in 
all or some of the color dimensions. 



Hiding Information Out-of-Phase 

[0072) Now consider our inventive out-of-phase digital watermarking techniques 
with reference to FIGS. 3a and 3b. In FIG. 3a, the dash/dot C, M, Y and K lines 
represent, respectively, cyan, magenta, yellow and black color channels for a line (or 
other area) of a media signal (e.g., a picture, image, media signal, video frame, 
document, etc.). The FIG. 3a lines represent a base level or a particular color level, 
color intensity or gray scale. Of course, it is expected that the color level (or gray- 
scale) will vary over the media signal. FIG. 3b illustrates the media of FIG. 3a, which 
has been embedded with our out-of-phase digital watermark signal. The watermark 
signal is preferably applied to each of the color component dimensions C, M and Y. 

[0073] In FIGS. 3a and 3b, the M and Y channels are represented by one signal, since 
these color components can be approximately equal, but separate signals. Of course, it 
is not necessary for these components to be equal, and in many cases the yellow and 
magenta components are not equal. The illustrated "bumps" (or "tweaks") in FIG. 3b 
represent the digital watermark signal, e.g., corresponding (or are spatially aligned) 
upward and downward signal adjustments in relation to a respective color channel (e.g., 
color levels or luminance values) at given points over the media signal. The tweaks are 
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preferably applied at the same level (or signal strength). Alternatively, the bumps are 
applied with a different signal strength (or tweak level) when compared to one another. 
Of course, these tweaks can be embedded over a color channel in a predetermined 
pattern, a pseudo random fashion, a spreading fashion, etc., to facilitate embedding of a 
digital watermark signal. 

10074] For the K dimension (or channel), the digital watermark signal is preferably 
embedded to be out-of-phase with respect to the CMY channels. Most preferably, the 
K channel is approximately out-of-phase (e.g., inverted) with the watermark signals in 
the CMY color channels, as shown in FIG. 3b. For example, if a digital watermark 
signal modifies each of the color channels at a media first location with a tweak level 
(e.g., color level adjustment) of say 7, then a tweak level of -7 correspondingly 
modifies the K channel at the media's first location. This inventive digital watermark 
technique is referred to as our out-of-phase (or "K-phase") digital watermark. (We note 
that if a watermark signal is determined in terms of luminance, we can assign or weight 
corresponding tweak levels to the respective color plane pixel values to achieve the 
luminance value tweak. Indeed, a tweak value can be spread over the CMY channels to 
achieve a collective luminance at a given media location. The luminance attributable to 
the CMY tweak at the given location is preferably cancelled or offset by the luminance 
attributable to a corresponding inverted K channel tweak at the given media location.). 

10075) With reference to FIG. 4, one out-of-phase embedding method generates (or 
determines) a watermark signal as shown in step SI . The watermark signal is 
embedded in the CMY channels in step S2. The inverse of the watermark signal is 
calculated in step S3, and such inverse signal is embedded in the K channel in step S4. 
Of course, the order of such steps is not critical. For example, a watermark signal can 
be determined, and an inverse calculated. The various color component dimensions can 
then be embedded. In another embodiment, the K channel is embedded with a 
watermark signal. An inverse signal is calculated, and the CMY channels are 
embedded with the inverse signal. 
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[0076] Our inventive watennarking scheme greatly reduces watermark perceptibility. 
Since the watermark signal for the K channel is applied to be approximately inverted 
when compared to the respective (or collective) tweaks applied to the C, M and/or Y 
channels, the watermark visibility is greatly reduced. The visibility reduction is 
achieved by the effective cancellation of perceived luminance changes when the 
CMYK image is viewed or printed. Indeed, combining an inverted watermark signal 
"tweak" or "bump" in a K channel with a corresponding non-inverted watermark signal 
tweak or bump in the CMY channels effectively cancels an overall perceived 
luminance change for a given area - greatly reducing visibility of the digital 
watermark. 

Image Embedding 

[0077] One application of our above out-of-phase embedding techniques is to hide an 
image in a media signal. The image can be a photograph, a graphic, a barcode (1-D or 
2-D), etc., etc. With reference to FIG. 5, an image 10 is steganographically hidden 
within media 12. Of course, media 12 may represent an image, photograph, video 
frame, graphic, picture, logo, product tag, product documentation, visa, business card, 
art work, brochure, document, product packaging, trading card, banknote, deed, poster, 
ID card (including a driver's license, member card, identification card, security badge, 
passport, etc.), postage stamp, etc., etc. And image 10 can correspond to a digital 
representation of a photograph, picture, graphic, text, orientation fiducial, code, object, 
barcode, message, digital watermark, outline, symbol, etc., etc. In the FIG. 5 example, 
image 10 includes a close-up photograph, and the media includes a driver's license or 
passport photograph. 

(0078] With reference to FIG. 6, our image hiding is preferably initiated by 
converting image 10 to a black channel image 10* (step S30 - FIG. 6). Most digital 
imaging software tools such as Adobe's Photoshop facilitate such a black channel 
conversion. The black channel image 10* includes a set of black pixel values (e.g., 
gray-scale values) 10\ A location in the media 12 is selected to place the black 
channel image (step S32). The dashed circle 13 in FIG. 5 represents this selected 
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location. The media 12 location can be represented by sets of media 12 pixels. (For 
example, a first set of pixels corresponds to the selected location's black channel 
values, a second set corresponds to the selected location's cyan channel values, a third 
set corresponds to the selected location's magenta channel values, and a fourth set 
corresponds to the selected location's yellow channel values.). The set of black 
channel image 10 % values is applied to the black channel pixels in the selected location 
13 of media 12 - effectively modifying media 12 (step S34). For example, if an image 
10* pixel includes a gray-scale value of 3, this gray-scale value is applied to a 
corresponding black pixel value in the selected media location 13 to raise that 
corresponding black pixel value by 3. In an alternative implementation, instead of 
adjusting the corresponding black pixel in the selected media 12 location by the gray- 
scale value, we replace that corresponding pixel value with the black image 10* gray- 
scale value. In another implementation, the corresponding media 12 black pixel is 
modified to achieve the gray-scale value of the image 10' pixel. Of course we can 
scale and/or weight the gray-scale value as needed prior to modifying pixels in the 
selected location 13 of media 12. 

[0079] The black channel image 10' is inverted to produce a set of signal tweaks (step 
S36). For example, if the black channel image includes a pixel tweak with a grayscale 
value of say 24, then a corresponding inverted tweak value for the CMY channels is - 
24. (In an alternative implementation, image 10 is converted into corresponding C, M 
and Y images and such images are inverted and then applied to their respective 
channels.). These signal tweaks are then used to modify or change the color values in 
their respective CMY color channels (step S38). Most preferably, in the above 
example, the -24-tweak value is applied to each of the CMY color channels. The 
overall luminance cancellation can be effected as such. In another implementation we 
spread the tweak value over the CMY channels to achieve an overall luminance change 
in a given media location to cancel the +24 tweak in the black channel. For example, if 
using a luminance equation of: L « 0.3*C + 0.6*M + O.l ^Y, we can achieve an overall 
luminance tweak of -24 by tweaking C = -15, M = -30 and Y = -15. Of course there is 
a vast range of other color combinations to achieve the same collective luminance 
change. Care should be taken, however, to minimize a color shift when using this 
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tweak-spreading alternative. The CMY pixels and the K pixels are thus out-of-phase 
with respect to one another - resulting in a local cancellation of the perceived 
luminance change. Accordingly, image 10 is successfully hidden or carried by media 
12. 

[0080] We note that the selected location 13 can be determined manually, e.g., via 
editing software tools (like Adobe's Photoshop). Or the selection process can be 
automated. 

Hiding Enhancements 

[0081] We have developed enhancements that can be optionally applied to our out-of- 
phase hiding techniques. These enhancements apply to hiding both images and digital 
watermark signals (in this section both will be referred to as a hidden signal). While 
these techniques are not necessary to cany out our out-of-phase hiding techniques, they 
generally reduce the visibility of a hidden signal. 

High Luminance Areas 

[0082] Media 1 2 may include areas of low CMY and/or K ink (or signal intensity). 
In a first case, an area includes little or no C, M and/or Y ink. This results in an 
inability to counteract (or cancel) an inverted signal in a corresponding K channel. 
Accordingly, we can sample the luminance of a media 12 area (or pixel) and, based on 
the luminance level, determine whether to scale back the hidden signal strength. For 
example, we begin to scale back the signal strength once the luminance reaches a 
predetermined threshold (e.g., in a range of 70 - 95 % luminance). We can scale back 
the signal strength for a given area according to a linear reduction, as shown in FIG. 7, 
or we can scale the signal strength in a non-linear manner, e.g., as shown in FIG. 8. 
The illustrated scaling signal strength applies to both the K channel and CMY channels. 
In a related implementation, we determine the luminance of the yellow channel, and 
then we base our scaling decisions on the yellow luminance percentage. 
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Saturated Color 

[0083] Hiding signals in a saturated color area can also result in increased hidden 
signal visibility. For this document the term "saturation" refers to how pure a color is, 
or refers to a measure of color intensity. For example, saturation can represent the 
degree of color intensity associated with a color's perceptual difference from a white, 
black or gray of equal lightness. We determine the color saturation level in a color 
plane (e.g., the yellow color plane), and then scale back a hidden signal strength as the 
color saturation level exceeds a predetermined level (e.g., in a range of 70-95 % yellow 
color saturation). As with the FIGS. 7 and 8 implementations, we can scale the signal 
strength in a linear manner (FIG. 9) or in a non-linear manner (FIG. 10). 

Low or High Luminance Areas 

[0084] We have found that we can even further improve the visibility characteristics 
of our hidden signals by considering the amount of luminance at a given pixel or other 
media 12 area. A low luminance may indicate that there is insufficient CMY to 
compensate for a K channel tweak. For example, a 10 % luminance in CMY for a 
given pixel implies that the pixel can accommodate only about a 10% signal tweak 
(e.g., remember the simplified luminance relationship mentioned above: L = 0.3*C + 
0.6*M + 0.1 *Y). With reference to FIG. 1 1, we can cap (or limit) the positive K tweak 
signal level in such low CMY areas to ensure that the CMY levels can be sufficiently 
decreased to counteract or cancel the positive K channel signal. 

[0085] Similarly, in an area of high CMY luminance, a negative K channel tweak can 
be capped (or limited) to ensure a sufficient range to increase the CMY values. 

Equalizing Detectabilitv 

[0086] Now consider an implementation where media 12 is segmented into a plurality 
of blocks (FIG. 12). Here a block size can range from a pixel to a group of pixels. We 
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redundantiy embed an image or watermark signal in each of (or a subset of) the blocks. 
In one implementation, as shown in FIG. 13, we preferably use signal feedback (k) to 
regulate a redundant embedding process. A signal feedback (k) method is shown in 
FIG. 1 4. A black (K) channel image or watermark signal (in this section hereafter both 
referred to as a "watermark") is embedded in block i of media 12 (step 110), where "i" 
is an integer ranging from 1 - n and where n is the total number of blocks. The 
watermark signal is inverted (step 1 12) and embedded in the CMY channels of block i 
(step 114). At this point, we preferably perform a detection process of the signal 
embedded within the i th block (step 116). The detection process determines whether 
the signal is sufficiently detectable (step 1 18). The term "sufficient" in this context can 
include a plurality of different meanings. One meaning of "sufficient" implies that the 
signal is detectable. Another meaning implies that the detectability of the signal is 
ranked (e.g., in terms of error correction needed, ease of detectability, or a detection- 
reliability metric, etc.). The term sufficient in a ranking context also implies that the 
detection ranking is above a predetermined threshold. The process moves to embed a 
new block i+1 if the embedding is sufficient (120). Otherwise the signal strength is 
increased or otherwise altered (step 122) and the embedding of block i is repeated. 

(0087] Such a signal feedback process helps to ensure consistent embedding 
throughout media 12. 

Infrared Image Detection 

[0088] An infrared detection method for a signal embedded with our out-of-phase 
embedding techniques is illustrated with reference to FIG. 15a. The illustrated 
detection method employs infrared illumination to facilitate image (or watermark) 
detection. Media 12 is illuminated with an infrared illumination source 14. The media 
12 is embedded as discussed above, for example, to include various components in a 
multicolor dimension space (e.g., CMYK). A first component (or image) is preferably 
embedded in the CMY channels. A second component (or image) is embedded in the 
K channel. The second component is preferably inverted with respect to the CMY 
channels. 



BNSDOCID: <WO 03005291A1J. > 



WO 03/005291 



PCT/US02/20832 



-20- 

100891 Infrared illumination source 1 4 preferably includes a light emitting diode, e.g., 
emitting approximately in a wavelength range of 800nm - 1400nm, or a plurality of 
light emitting diodes ("LED"). Of course, there are many commercially available 
infrared diodes, and such may be suitable interchanged with our watermark detection 
techniques. It will be appreciated that many commercially available incandescent light 
sources emit light both in the visible and infrared ("IR") spectrums. Such incandescent 
light sources may alternatively be used as infrared illumination source 14. Indeed, 
infrared watermark detection may be possible in otherwise normal ("daylight") lighting 
conditions, particularly when using an IR-pass filter. 

[0090] A conventional power source powers the infrared illumination source. (We 
note that a variable trim resistor and a small wall transformer can be optionally 
employed to control illumination source 14.). Power alternately can be supplied from a 
battery pack, voltage or current source, or by directly tapping a power source of a 
camera, e.g., internally drawn from a parallel, USB, or corded power lines. For a 
consumer device, a battery pack or a single power cord that is stepped down inside a 
digital watermark reader housing can also be used. 

[0091 1 Returning to the composition of an out-of-phase hidden image (or watermark), 
a first image (or watermark) component is embedded in a K (or black) channel. A 
second image component, e.g., which is out-of-phase with respect to the K channel, is 
embedded in the CMY channels. These characteristics have significance for infrared 
detection. In particular, C, M and Y inks will typically have high transmission 
characteristics in the infrared spectrum when printed, which render them nearly 
imperceptible under infrared illumination. Yet conventional black inks absorb a 
relatively high amount of infrared light, rendering the black channel perceptible with 
infrared illumination. We note that standard processing inks, such as those conforming 
to the standard web offset press (SWOP) inks, include black ink with IR detection 
properties. Of course, there are many other inks that may be suitably interchanged with 
this aspect of the present invention. 
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[0092] As discussed above our out-of-phase embedding provides an effective 
cancellation of perceived luminance changes when the CMYK image is viewed in the 
visible spectrum. Indeed, combining an inverted watermark signal "tweak" or "bump" 
in a K channel with a corresponding non-inverted watermark signal tweak or bump in 
the CMY channels effectively cancels an overall perceived luminance change. 
However, under infrared illumination, the hidden image (or watermark) component in 
the black (K) channel becomes perceptible without interference from the C, M and Y 
channels. An infrared image primarily portrays (e.g., emphasizes) the black channel, 
while the C, M and Y channels are effectively imperceptible under infrared 
illumination. 

[0093] In one implementation, camera 16 captures an image of media 12. Preferably, 
camera 16 includes an IR-Pass filter that passes IR while filtering visible light. For 
example, the Hoya RM90 filter available from M&K Optics L.L.C. is one of many IR- 
Pass/Visible Opaque filters suitable for daylight detection. Another suitable filter is the 
RG850 filter, part number NT54-664, available from Edmund Scientific. These filters 
are offered as examples only, and certainly do not define the entire range of suitable 1R- 
pass filters. Of course there are many other IR-Pass filters that are suitably 
interchangeable with this aspect of the present invention. 

[0094] In yet another implementation, a conventional digital camera (or web cam) is 
modified so as to capture infrared light. In particular, most digital cameras and web 
cams include an IR filter, which filters out IR light. Removing the IR filter allows the 
camera to capture light in the IR spectrum. Consider a visibly dark environment (e.g., 
an enclosed case, shielded area, dark room, etc.). Media 12 is illuminated by infrared 
illumination source 14 in the visibly dark environment. Camera 16 (without an IR 
filter) effectively captures an infrared image (i.e., the K channel image) corresponding 
to the illuminated media 12. 

[0095] The captured image is communicated to computer 18. Preferably, computer 
18 includes executable software instructions stored in memory for execution by a CPU 
or other processing unit. If media 12 includes a digital watermark, the software 
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instructions preferably include instructions to detect and decode the embedded digital 
watermark. Otherwise, the instructions preferably include instructions to display or 
analyze the K-phase image. The software instructions can be stored in memory or 
electronic memory circuits. Of course, computer 18 can be a handheld computer, a 
laptop, a general-purpose computer, a workstation, etc. Alternatively, computer 18 
includes a hard-wired system, which precludes the need for software instructions. 

[0096] With reference to FIG. 15b, a detection housing 20 can be provided to house 
an infrared illumination source 14 and digital camera (both not shown in FIG. 15b, 
since they are within the opaque housing 20). The housing 20 is preferably opaque to 
shield (or otherwise constructed to filter) the camera and media 12 from visible light. 
The housing 20 has an opening 20a to receive the media 12. In a first case, opening 
20a is adapted to engulf media 12. This allows media 12 to be placed on a surface 
(e.g., table, imaging station, or counter) and the housing opening 20a to be placed over 
media 12, effectively shielding media 12 from visible light. In a second case, the 
opening 20a receives media 12 into (e.g., slides media through opening 20a) and 
positions media 12 within the opaque housing 20. In either implementation, the 
infrared illumination source 14 illuminates media 12, and the digital camera 16 
captures an image of the illuminated media (e.g., captures as image of the K-channel 
image). The camera 16 communicates with computing device 1 8, which detects and 
decodes a digital watermark embedded with media 12, if present, or otherwise displays 
the image. 

[0097] In another illustrative embodiment, the above described infrared detection 
technique is carried out in a visibly dark environment, such as a dark room, shielded 
area, etc. An out-of-phase image (or digital watermark) is embedded in media. The 
media is illuminated with an infrared illumination source, and a digital camera captures 
an image of the illuminated media. 

[0098] In still another illustrative embodiment, the above described infrared detection 
technique is carried out in a visibly lighted environment. An out-of-phase image (or 
watermark) is embedded in media. The media is illuminated with an infrared 
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illumination source, and a digital camera captures an image of the media. Preferably, 
the camera includes an IR-pass filter. The digital camera communicates with a 
computing device, which detects and decodes an out-of-phase image (or digital 
watermark) embedded in the media. 

(0099] Infrared detection is an elegant solution to detect out-of-phase images or 
digital watermarks, since high transmission colors in the IR spectrum are effectively 
washed out, allowing detection of a low transmission color channel. Specialized inks 
are not required to embed the out-of-phase digital watermark. Indeed most multicolor 
printer ink packs, offset ink, process inks, dye diffusion thermal transfer inks, such as 
inks conforming to the SWOP standard, include black inks that allow infrared 
detection. Some of these inks include a carbon-based black ink, furthering the 
absorption of IR. While infrared detection is ideal for out-of-phase images or digital 
watermarks, this method is also applicable to detection of conventional digital 
watermarks. For instance, a watermark signal can be embedded only in a black channel 
of media. Infrared illumination helps to reveal the embedded watermark in this black 
channel. Alternatively, a digital watermark is embedded across many color planes, 
while detection is carried out in only those color planes that are perceptible with IR 
illumination. Additionally, while we have discussed infrared detection techniques, we 
note that ultraviolet (UV) detection is also possible. In this case, one of the color 
channels (including the K channel) preferably includes UV pigments or properties. A 
U V detection process is carried out in a manner analogous to that discussed above. 
(We also note that a CMY color can include IR/UV pigments or properties to facilitate 
detection of that color with respective IR or UV detection methods.). 

High resolution Scan 

[01 00] We now discuss an alternative detection method and system for detecting an 
out-of-phase, color component-based digital watermark. Consider a first 
implementation as depicted in FIGS. 16 and 17. A media signal is analyzed as follows. 
Initially, luminance values are determined for CMY and K color planes (FIG. 16). The 
CMY luminance can be computed as a properly weighted sum of the cyan, magenta 
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and yellow primary components. For example: Lum = .3C + .6M+.lY. (Of course, as 
will be appreciated by those skilled in the art, other weighting coefficients can be used 
to determine a CMY luminance.). So for a given point (or pixel), a luminance value is 
determined for the CMY color dimensions. Similarly, as shown in FIG. 17, a 
luminance value for K is determined. In one embodiment, the K luminance equals the 
value of the K component. 

[01 01 ] The detection process is further described with respect to FIG. 1 8. In step 
S10, a luminance value is determined from the collective contribution of the CMY 
channels at a given image location, and luminance attributable to the K channel is 
determined for the area: 

CMY => lumens 
K -> lunik , 

where lum cm y is the luminance of CMY and lum k is the luminance of K. In step SI 1 , 
lumjc is subtracted from lumcmy: 

Lum rina , = lumcmy - lum k . 

[0102] The step SI 1 subtraction operates to help reduce image content, and to 
reinforce the watermark signal by effectively adding the K watermark signal value to 
the CMY watermark signal, since the K watermark signal is the inverse of the CMY 
channel signals. 

[0103] As shown in step SI 2, Lumnnai can be analyzed for watermark detection. 
Fragile Watermark 

[01 04] An out-of-phase watermark is fragile since a signal processing operation that 
combines the K channel with the CMY channel effectively cancels the watermark 
signal due to the combination of the inverted and non-inverted signal tweaks. 
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Conversion to other color spaces similarly degrades the watermark signal. Take a 
typical scan/print process for example. Digital scanners typically scan images in a 
RGB color space. Scanning an out-of-phase embedded, CMYK printed image 
degrades the embedded watermark due to the combination of the K signal (inverted) 
with the CMY signal (non-inverted) in a local area. When the RGB image 
representation is printed, the watermark signal is difficult to detect, particularly with a 
low resolution RGB scan. Similarly, other conversions, such as to a L*a*b color space, 
degrade the out-of-phase watermark due to the combination of K with CMY throughout 
local areas. Nevertheless, the watermark signal is detectable with CMYK data as 
described above with respect to FIG. 18. 

[0105] A fragile watermark has utility in many applications. Take counterfeiting, for 
example. The inventive fragile watermark is embedded in original CMYK media. If 
the media is copied, the embedded fragile watermark is either lost or degrades 
predictable. The copy is recognized as a copy (or counterfeit) by the absence or 
degradation of the fragile watermark. Fragile watennarks can also be used in 
conjunction with other watermarks, such as robust watermarks. The fragile watermark 
announces a copy or counterfeit by its absence or degradation, while the other robust 
watermark identifies author, source, links and/or conveys metadata or other 
information, etc. In other embodiments, a fragile watermark is an enabler. For 
example, some fragile watermark may include plural-bit data that is used to enable a 
machine, allow access to a secure computer area, verify authenticity, and/or link to 
information. This plural-bit data is lost or sufficiently degrades in a copy, preventing 
the enabling functions. Other fragile watermark applications are discussed in the U.S. 
patent applications mentioned above. 

High Resolution Scan of Watermarked Image 

[01061 Oftentimes, CMYK data is not available for a watermark detection process. 
For example, a watermarked CMYK image may be optically scanned with a scanner 
that scans the printed CMYK data in a different color space, such as RGB. A high 
resolution RGB scan may nevertheless be used to recover an estimation of the 
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watermark signal, which would be otherwise undetectable with a low RGB resolution 
scan. In this case, pixels can be assigned color or K values to generate respective color 
and K planes. A final luminance value can be determined from these planes. Consider 
the following method, as shown in FIG. 19, for a high resolution RGB scan (e.g., about 
8 times the screen ruling or more) of a CMYK image. 

[0107] In step S20, a color saturation (ColSat) value is determined for each RGB 
pixel. ColSat can be calculated by dropping a perpendicular line from a measured RGB 
value (e.g., R*, G 0 , B Q , as shown in FIG. 20) to the RGB luminance axis. This color 
saturation calculation alternatively can be approximated by: 

ColSat = max(RGB) - min(RGB), 

where max(RGB) is determined by taking the maximum of the red, green and blue 
values Ro, G 0 , B Q , and min(RGB) is determined by taking the minimum of the red, 
green and blue values Ro, Go, B b . Of course, other known methods for determining a 
color saturation value are suitably interchangeable with this step. 

[0108] In step S22, preferably for each RGB pixel (or pixel area), it is determined 
whether ColSat < T CO i, where T co j is a predetermined threshold color saturation, e.g., 
based on a scanner calibration, detection sensitivity and/or other threshold number. For 
example, a pure cyan pixel will typically correspond to a (0, 100, 100) RGB value. 
However, a scanner may read this pixel as a (20, 80, 80) RGB value. The threshold 
value T CO i can be set to allow for such scanner sensitivity. T co i can also be adjusted to 
reflect acceptable tolerances. If ColSat < T CO i, flow continues to step S24, where it is 
determined whether the maximum measured (e.g., determined, scanned, calculated, 
etc.) pixel value is < T| . Here, T\ is a predetermined pixel value, e.g., based on 
scanner calibration, detection sensitivity and/or other threshold numbers. 

[0109] FIG. 21 illustrates a graphical relationship that shows digital threshold and 
scanner pixel values on a scale between Black (0) and white (255). Value Sb is a 
scanner measured (or designated) black, which, due to scanner sensitivity and/or 
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characteristics, is generally offset from black (0). Similarly, SCMY is a scanner 
measured CMY overprint (e.g., a 100% overprint). If the maximum pixel value is < T t 
the pixel is designated as black (K) in step S26. A corresponding pixel range is shown 
graphically in FIG. 21, as the values less than T|. As discussed, Tj can be selected 
based on scanner characteristics. In one embodiment, T| is selected to have a value 
midway between scanner-measured black (Sb), and scanner measured CMY overprint 
(Scmy). Of course, Tj can be adjusted from this midpoint value to accommodate 
sensitivity requirements and/or scanner characteristics. (A maximum pixel value can 
be chosen in a number of known techniques, such as selecting the color component of a 
pixel, e.g., if a measured pixel value corresponds to (20, 70, 80), the color component 
80 comprises the maximum pixel value.). 

fOllO] If the max pixel value is not < Ti, the pixel value is compared against another 
threshold value. In step S28, it is determined whether the max pixel value is < T2. If 
so, the pixel is designated as color in step S30. Returning again to FIG. 21 , the 
corresponding range of pixel values falls between Ti and T2. The threshold value T2 
can be selected based on scanner characteristics, or based on sensitivity requirements. 
In one embodiment, T2 is selected to have a value midway between Scmy and white 
(255). Of course, this value can be adjusted based on sensitivity need and/or scanner 
characteristics. 

[01 1 1 J If the max pixel value is not < T2, the pixel value is designated as white in step 
S32. The corresponding pixel range lies between T 2 and white (255). 

[01 1 2] If in step S22, it is determined that ColSat is not < T co i» flow continues to step 
S34, where it is determined whether the max pixel value is < T 3 . If so, the pixel is 
designated as a color pixel in step S36. Here, T 3 is a predetermined pixel value. In one 
embodiment, T3 is selected to have a value midway between a scanner measured (or 
determined) yellow value and white (255). Of course, this value can be adjusted based 
on sensitivity requirements and/or scanner characteristics. Otherwise, the pixel value is 
designated white in step S38. This relationship is shown in FIG. 22, where So S M and 
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S Y corresponding with scanner measured (or determined) cyan, magenta and yellow 
values. 

[01 13] Color and K planes can be constructed once each RGB color pixel is 
designated as a color, white or K pixel. 

[01 14] To create the K plane, pixels designated as black are turned "on," while the 
pixels that are designated as white or color are turned "off." In one embodiment, the 
respective "off' pixels are masked. In another embodiment, the off pixels (or 
alternatively the on pixels) are flagged or otherwise marked to indicate their 
designation and/or inclusion/non-inclusion. 

[01 15] Similarly, to create the color plane, pixels designated as "white" or "black" are 
turned off, while the rest of the pixels (e.g., the color pixels) are turned on. 

[01 16] The pixel (or area) values are summed for the color plane to obtain a low 
resolution (LR) color luminance (lumc 0kjT ) per pixel (or per area). Similarly, the pixel 
values are summed for the black plane to obtain a LR black luminance (lum*). A final 
luminance value (lumnnai) for each pixel (or area) can be determined from: 

luminal = lurricoior - lumk. 
The lumfinai value can be passed into a watermark detection process. 

[0117] FIG. 23 illustrates one possible summing method for each color (color and K) 
plane according to a preferred embodiment to achieve the above color and black 
luminance values. 

[01 18] In step S40, each of the luminance values within a predetermined window (or 
pixel area) are summed. The window may be an n x n window, or and n x m window, 
where n and m are integers. In a preferred embodiment, pixels values with an 8 X 8 
pixel window are summed. The resulting summation value is preferably saved for 
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comparison against the other plane (color or K), to determine lum r , n ai as discussed 
above. 

[01 19] In step S42, the window location with respect to the color (or K) plane is 
repositioned (e.g., the window is a sliding window). To illustrate, if a first window 
frames the first n x n (e.g., 8x8) pixels in a color (or K) plane, the second window is 
adjusted to cover a new area, or an overlapping area. In the preferred embodiment, the 
window slides right (or horizontally) by four (4) pixels (e.g., if the first window 
captured the first 8 pixels, then on a first window slide, the window would then cover 
the 5 th - 12 th pixels X 8). The luminance values within this second window are added 
in step S44. This value is preferably saved for comparison against the other color plane 
(or K plane), to determine lumr, na i as discussed above. 

[0120J The method determines if the window is at the end of a line (e.g., at the end of 
a plane edge) in step S46. If not, flow continues to step S42, where the window 
location is again repositioned. Otherwise, it is determined whether the entire plane has 
been analyzed in step S48. If so, the method ends. Otherwise, the window location is 
repositioned in step S50. The step S50 location adjustment preferably moves the 
window location down (or vertically) with respect to the plane to cover a new area or 
an overlapping area. In the preferred embodiment, the window is shifted down by 4 
pixels. At this step, it is important to note that the new window location need not be 
realigned at the starting point (e.g., the top-left corner of the plane), but may be shifted 
down at the right plane edge. The window may then slide right to left. Of course, the 
step S50 alignment may locate the window below the original starting point (e.g., the 
left plane edge), with the window sliding left to right. Flow continues from step S50 to 
S40. 

[0121] This process is preferably carried out for each of the color and K planes. The 
resulting area black luminance values are subtracted from the corresponding resulting 
color luminance values to achieve the final luminance value. This final luminance 
value (for each location area) can be analyzed to detect the watermark signal. 
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Applications 

(01 22J Now consider a few applications of our inventive out-of-phase hiding 
techniques. 

Identification Documents (e.g.. Passports, Driver's Licenses, etc.) 

[0123] An out-of-phase image is hidden in an identification document to provide 
enhanced security. For example, a hidden image is a gray-scale version of the 
identification document's photograph. An airport screener, or law enforcement officer, 
illuminates the out-of-phase image with infrared (or ultraviolet) light for comparison of 
the hidden image to the printed photograph. Or, instead of a photograph, the hidden 
image may include text, which can be compared with the visibly printed text on the 
identification document. Still further, an identification document may include 
information steganographically hidden out-of-phase according to our presently 
disclosed techniques. 

Hiding Bar Codes in Out-of-Phase Channels 

10124J Over the years, a number of standards organizations and private entities have 
formed symbology standards for bar codes. Some examples of standards bodies 
include the Uniform Code Council (UCC), European Article Numbering (EAN, also 
referred to as International Article Numbering Association), Japanese Article 
Numbering (JAN), Health Industry Bar Coding Counsel (HIBC), Automotive Industry 
Action Group ( AIAG), Logistics Application of Automated Marking and Reading 
Symbols (LOGMARS), Automatic Identification Manufacturers (AIM), American 
National Standards Institute (ANSI), and International Standards Organization (ISO). 

(01251 Th e UCC is responsible for the ubiquitous bar code standard called the 
Universal Product Code (UPC). AIM manages standards for industrial applications and 
publishes standards called Uniform Symbology Standards (USS). Some well know bar 
code schemes include UPC and UCC/EAN-1 28, Codabar developed by Pitney Bowes 
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Corporation, 1 2 of 5 and Code 128 developed by Computer Identics, Code 39 (or 3 of 
9) developed by Intermec Corporation, and code 93. 

[0126J Some bar codes, such as UPC, are fixed length, while others are variable 
length. Some support only numbers, while others support alphanumeric strings (e.g., 
Code 39 supports full ASCII character set). Some incorporate error checking 
functionality. 

[0127] While the bar codes listed above are generally one-dimensional in that they 
consist of a linear string of bars, bar codes may also be two-dimensional. Two 
dimensional bar codes may be in a stacked form (e.g., a vertical stacking of one- 
dimensional codes), a matrix form, a circular form, or some other two-dimensional 
pattern. Some examples of 2D barcodes include code 49, code 16k, Data Matrix 
developed by RVSI, QR code, micro PDF-417 and PDF-417. 

[01 28) For more information on bar codes, see D.J. Collins, N.N. Whipple, Using Bar 
Code- Why It's Taking Over, (2d ed.) Data Capture Institute; R.C. Palmer, The Bar 
Code Book, (3 rd ed.) Helmers Publishing, Inc., and P.L. Grieco, M.W. Gozzo, C.J. 
Long, Behind Bars, Bar Coding Principles and Applications, PT Publications Inc. 

[0129] A hidden, out-of-phase image can include a barcode. Consider the vast 
possibilities. A barcode is often disdained for aesthetic reasons, but a hidden, out-of- 
phase barcode can carry relatively large amounts of information while remaining 
virtually imperceptible. In one implementation, a barcode is redundantly hidden or 
titled throughout media using our out-of-phase embedding techniques. This allows for 
robust barcode detection even if only a portion of the media is recoverable. In another 
implementation one or more barcodes are placed in predetermined areas throughout the 
image. In still another implementation, a barcode reader, such as those provided by 
Symbol (e.g., the VS4000 and P300IMG models) or Welch Allyn (e.g., the Dolphin 
model), is augmented with an infrared illumination source and/or IR-filters. Once 
illuminated, the barcode reader detects and decodes a barcode hidden in a K channel. 
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Fiducials and Orientation Sienal 

[01 30] In some digital watermarking techniques, the components of the digital 
watermark structure may perform the same or different functions. For example, one 
component may carry a message, while another component may serve to identify the 
location or orientation of the watermark in a signal. This orientation component is 
helpful in resolving signal distortion issues such as rotation, scale and translation. In 
some cases, channel capacity is congested by an orientation signal. 

[01 31 J One improvement is to embed an orientation signal using our out-of-phase 
hiding techniques. The message component of a digital watermark can then be 
embedded using out-of-phase or non-out-of-phase embedding techniques. This 
improvement will increase message capacity, while improving visibility considerations. 
Scale, orientation, and image translation can be resolved based on the orientation of the 
fiducial. 

[0132] A related improvement embeds a plurality of fiducials or orientation markers 
54 in an out-of-phase channel of media 12 (FIG. 24). A watermark detection module 
detects the fiducials to identify image distortion, if any. 

Spot Colors 

[0133] We have found that our inventive techniques are not limited to process colors. 
Indeed, our out-of-phase techniques can be extended to spot colors. With reference to 
FIG. 25, and preferably (but not limited to) relatively darker spot colors, e.g., violets, 
blues, etc., we counteract a watermark signal (or image) embedded in the spot color 
channel with an inverted signal in a K channel. Preferably, the K channel base 
intensity is subtle (e.g., 0 % as represented by the K channel base level dashed line in 
FIG. 25) in comparison to the base level spot color intensity (e.g., 100% intensity as 
represented by the spot color maximum level dashed line in FIG. 25). The watermark 
signal (or image) signal is embedded through a combination of negative spot color 
tweaks and positive, offsetting, K channel tweaks. Infrared illumination facilitates 
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detection of the K-channel watermark tweaks. (Embedding a spot color need not be 
limited to negative tweaks. Indeed, if the spot color is not at 100% intensity, positive 
spot color tweaks and corresponding negative K channel tweaks can facilitate 
embedding.). 

Paper Information and Printing Processes 

[01 34] Another improvement is to carry printing process information and/or paper 
characteristics with a digital watermark. For example, a digital watermark may include 
signal gain or embedding characteristics that are specific to a printing press, printing 
process, process ink type or paper characteristics. The digital watermark can be 
embedded in a digital file, which is analyzed prior to a print run. The embedding 
process is adjusted according to the watermark data. Or the watermark signal can be 
analyzed after printing one or more test copies. The signal strength or payload metric 
can be analyzed to determine whether the process should be adjusted. 

[0135] Our out-of-phase digital watermark can be used to detect a misalignment in a 
printing process. With reference to FIG. 26 a printer 150 outputs a CMYK (or spot 
color, etc.) printed sheet 152. The printed sheet 152 includes an out-of-phase digital 
watermark or image hidden therein. An input device 154 captures an image of sheet 
152. Preferably, input device 154 captures a visible spectrum image of sheet 152. The 
input device provides the captured image (e.g., digital scan data) to a watermark 
detector 1 56. The watermark detector 1 56 analyzes the captured image in search of the 
embedded out-of-phase digital watermark. The watermark detector 156 should not be 
able to detect the embedded watermark if the printing of the CMY and K are aligned, 
due the localized luminance cancellation of the signal tweaks (or luminance changes). 
The term aligned in this context implies that the CMY and K are sufficiently inverted to 
allow localized cancellation. A misalignment is identified if the watermark detector 
156 reads the digital watermark. Such a misalignment is optionally communicated 
from the watermark detector 156 to the printer 150 or otherwise provided to announce 
the printing misalignment. Of course other alignment and color balance information 
can be identified from the detection of the digital watermark. 
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Color Channel Keys 

(0136] A related inventive technique embeds a key in one color channel for decoding 
a watermark in a second color channel. Consider an implementation where a first 
digital watermark is embedded in a first color channel. The first digital watermark 
includes a payload including a key. The key is used to decode a digital watermark 
embedded in a second color plane. The term decode in this context includes providing 
a reference point to locate the second watermark, providing a key to unlock, decrypt, 
decode or unscramble the second digital watermark payload, etc. Of course this 
inventive technique is not limited to our out-of-phase digital watermarks. 



Out-of-Phase Watermark based on Time-Decay Fluorescence 

[0137] fr^s and dyes have recently emerged with unique fluorescent properties. 
Some of these properties allow for variable fluorescence (or emission) decay times. 
Typical decay times can be varied from less than a microsecond to tens of milliseconds 
and more. A CCD scanner and microprocessor can measure the decay emissions from 
the inks and dyes. Other filtered optical capture devices (cameras, digital cameras, web 
cameras, etc.) can be suitably interchanged with the CCD scanner. These inks and dyes 
(both hereafter referred to as "ink") also include unique emission characteristics, such 
as emitting in a particular frequency band, which allows for frequency-based detection. 

[0138] Other unique characteristics include varying the frequency of light needed to 
activate the ink and the color of the ink's fluorescence. These characteristics can be 
variously combined to produce customized ink. These types of ink are typically excited 
with UV light and emit from ultraviolet (UV) to infrared (IR) wavelengths. To 
simplify the discussion, the term "UV" will be used to refer to ink that absorbs in the 
UV and emits in the UV and/or IR wavelengths. These inks are generally invisible 
when illuminated in the visible spectrum. Such inks are available from PhotoSecure in 
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Boston, Massachusetts, USA, such as those sold under the trade name of SmartDYE™. 
See SPIE's September 2001 OE Magazine, pages 8-9 written by M. Brownell 
("Counterfeiters Dye Over Security Measures"), for a further discussion of such inks. 
Of course other manufacturer's inks that have variable emission decay times can be 
suitably interchanged with this aspect of the present invention. 

[0139J The present invention utilizes UV inks having different, yet generally 
predictable fluorescence decay times. The inventive digital watermark preferably 
includes at least two components (or signals) each of which is embedded with a UV ink 
that has a different fluorescence decay time. 

[0140] Consider a baseline signal illustrated in FIG. 27. The baseline signal 
represents white paper, a flat signal or an image signal that includes various color or 
grayscale components. Fig 27 also illustrates the baseline signal including a first digital 
watermark signal ("short decay") embedded therein. The illustrated "bumps" in FIG. 
27 represent the watermark signal, e.g., upward or downward signal adjustments in 
relation to the respective baseline signal. If the baseline signal is paper, the short decay 
watermark signal can be applied (e.g., printed) to the paper. The short decay 
watermark signal is preferably printed with ink having a relatively short fluorescence 
decay curve as shown in FIG. 28a. The decay time extinction shown in Fig 28a 
preferably ranges from less than 1 millisecond (ms) to about 10 ms. Of course this 
range can be expanded according to need, 

[0141 ] FIG. 27 also illustrates the baseline signal embedded with a second digital 
watermark signal ("long decay 1 *). The long decay watermark signal is preferably 
embedded to be out-of-phase with respect to the short decay watermark signal. Most 
preferably, the long decay signal is approximately inverted with respect to the short 
decay signal. If the baseline signal is paper, the long decay watermark signal can be 
applied (e.g., printed) on the paper. The long decay watermark signal is preferably 
printed (e.g., applied) with ink having a relatively longer fluorescence decay curve as 
shown in FIG. 28b. The decay extinction time shown in FIG. 28b preferably ranges 



BNSDOCID: <WO 03005291AM..> 



WO 03/005291 



PCT/US02/20832 



-36- 

from several milliseconds (ms) to about 100 ms. Of course this range can be extended 
according to system need. 

[0142] The short decay and long decay signals are preferably printed or otherwise 
applied to paper (or other surfaces). These collective signals form a time-dependent, 
u out-of-phase" digital watermark. Such a digital watermark has unique and desirable 
properties. A first property is that the digital watermark is preferably invisible when 
illuminated in the visible spectrum, since it is applied with the UV inks discussed 
above. A second property is that the digital watermark signal is imperceptible with 
steady state (e.g., constant) UV illumination. Imperceptibility is caused by local area 
cancellation of the first and second digital watermark signals. Indeed, since the second 
digital watermark signal (long decay signal) is inverted with respect to the first digital 
watermark signal (short decay signal), the luminance attributable to each of the two 
signals effectively cancel each other out under constant UV illumination. The visible 
result under steady-state illumination is the flat signal (e.g., the baseline signal). 

[0143] Another desirable quality is that UV inks prevent almost all other successful 
counterfeit attempts, since the specific UV and delay properties are extremely difficult 
to replicate, particularly for a casual counterfeiter. 

Out-of-Phase Digital Watermark Detection 

[0144] Exciting the digitally watermarked ink with UV illumination facilitates 
detection. Preferably, a pulse 60 of UV wavelength light as shown in FIG. 29 
stimulates the digitally watermarked UV ink. The UV inks begin their emission decay 
at TO or near to the falling edge of the UV pulse. The first watermark signal's (short 
decay) fluorescence emissions decay in a relatively short time (Tl) as shown by the 
dotted curve in FIG. 30. The second watermark signal's (long decay) fluorescence 
emissions decay in a relatively longer time (T3) as shown by the solid curve in FIG. 30. 
The digital watermark is detectable from the longer decaying ink after emissions from 
the first ink decay (Tl), but before emissions from the second ink decay (T3). The 
signal is detectable in this'Tl-T3 range since it is free from the canceling effects of the 
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short decay ink. Of course, the second watermark signal may be more readily detected 
in a range of Tl - T2, due to emission strength in this range. In alternative cases, the 
Tl and T3 points mark predetermined decay levels, instead of emission extinction 

points. For example, at Tl the short decay ink may have decayed to a predetermined 

\ 

level. This level may be determined based on acceptable interference levels with 
respect to the longer decay ink, or vice versa. 

[0145] A camera (or CCD sensor) can be gated or enabled (e.g., operating during the 
Tl - T2 time range shown by the dashed lines in FIG. 30) to capture emissions after the 
short decay time ink decays (Tl), but while the long decay time ink is still emitting 
(until T3). (Alternatively, the camera can continuously capture UV emissions until a 
watermark signal is detected.). The digital watermark can be detected and decoded 
from this captured image. Of course, a gated range can be varied according to ink 
delay times and may even be varied as part of a security measure. For example, ink 
decay time (or the relative decay window between the first and second ink) can be 
maintained in secrecy or can be randomly varied. The particular gating window is then 
supplied to a camera for detection calibration. Alternatively, a separate robust 
watermark may carry encoded (or encrypted) information that suggests the decay 
windows. Or another identifier may be used to access the particular decay time 
information. 

Embedding the Out-of-Phase Watermark with Separate Plates 

[0146] In one embodiment, the short and long decay time inks are printed by separate 
printing plates, which are overprinted on top of a conventionally printed image (or 
blank paper or documents). For example, the short decay ink is separately overprinted 
on the image with a first plate, and then the image is overprinted with a second plate 
carrying the long decay time ink. As discussed above the short and long decay time 
inks are generally invisible when illuminated in the visible spectrum, so such 
overprinting is typically imperceptible in the visible spectrum. Some printing processes 
involve printing a laminate or overlay. The first and second plates can be used in this 
(or after) laminate or overlay process. 
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[0147] The overprinted inks can be detected as discussed above with respect to 
FIG. 30. 

Embedding the Out-of-Phase Watermark with CMYK 

[0148] Images that are stored in CMYK format, have built in redundancy since many 
different combinations of CMYK can be used to represent the same color. Advantage 
can be taken of this redundancy in a watermarking process to reduce the visibility of 
the watermark. 

[01 49] Now consider FIG. 3 1 , where the dash/dot C, M, Y and K lines represent 
respective cyan, magenta, yellow and black color dimensions for a line in a color patch 
of a media signal (e.g., a line in a picture, image, document, etc.). The various color 
lines are embedded with a watermark signal. The watermark signal is preferably 
applied to each of the color component dimensions (C, M and Y). The M and Y 
channels are represented by one signal in FIG. 31, since these color components can be 
approximately equal, but separate signals for various graylevels. Of course, it is not 
necessary for these components to be equal, and in many cases the yellow and magenta 
components are not equal. The illustrated embedded "bumps" represent the watermark 
signal, e.g., upward or downward signal (e.g., color level) adjustments in relation to the 
respective color channel at given points over the baseline (color) signal. For the K 
dimension (or channel), the watermark signal is preferably embedded to be out-of- 
phase with the CMY channels. Most preferably, the K channel is approximately 
inverted with the watermark signals in the CMY color channels, as shown in FIG. 31. 
Collectively these color channels are referred to as a CMYK out-of-phase digital 
watermark. 

[0150] Preferably, a long decay time UV ink (FIG. 28b) is combined with the K 
channel ink. Similarly, a short decay time UV ink (FIG. 28a) is combined with the 
CMY channel inks. As discussed, the UV inks are generally imperceptible when 
illuminated in the visible spectrum, yet emit detectable UV and/or IR emissions when 
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excited by a UV light source (e.g., UV Diode, Laser UV diode, UV illumination source, 
etc.). 

[0151] The watermark tweak for the K channel (including a first UV ink) is applied 
out-of-phase in comparison to the changes applied to the CMY channels (including a 
second UV ink). Thus the watermark visibility is greatly reduced. The low visibility 
properties result by the effective cancellation of the non-inverted signal by the inverted 
signal. The low visibility properties hold for situations involving steady-state UV 
illumination as discussed above for the FIG. 27 out-of-phase watermark. 

[0152] The out-of-phase digital watermark can be detected by illuminating the printed 
image with a pulse of UV light. A camera is gated to capture the image after emissions 
from the short decay time ink are extinguished, but while the long decay time ink is still 
emitting. Alternatively, a camera continuously (or periodically) captures image data 
until a watermark detection process finds a watermark signal (e.g., such as after Tl in 
FIG. 30). The captured image is passed into a watermark detection process to detect 
the watermark signal. 

[0153] With reference to FIG. 32a, media 100 includes an out-of-phase digital 
watermark applied with UV inks. The out-of-phase watermark can be a CMYK 
watermark or a two-channel watermark shown with reference to FIG. 27. Media 100 is 
excited by a UV illumination source 101. Media 100 can include documents, tags or 
labels, certificates, graphics, plastics, fabrics, metals, films, polymers, artwork, images, 
text, barcodes, photographs, etc., etc. UV illumination source 101 preferably emits a 
UV pulse such as shown in FIG. 29. The UV pulse excites the UV inks on media 100. 
The UV inks emit fluorescence emissions that begin to decay on (or near) the falling 
edge of the UV pulse. Camera 102 captures an image of the UV emissions. Camera 
102 can be gated to capture an image after the decay of a shorter decay time ink, but 
before the decay of a longer decay time ink. The captured image is communicated to 
computer 104. Of course, camera 102 can communicate with computer 104 via a 
wireless, tethered link or other communications channel. Preferably, computer 104 
includes executable software instructions to detect and decode the digital watermark 
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signal embedded within media 100. The software instructions can be stored in memory 
or electronic memory circuits. Of course, computer 104 can be a handheld computer, a 
laptop, a general-purpose computer, a workstation, etc. Alternatively, computer 104 
includes a hard-wired implementation, which precludes the need for software 
instructions. 

[0154] In one embodiment (FIG. 32b), a start signal is communicated to illumination 
source 101 and camera 102. The start signal enables illumination source 101 and 
camera 102. The start signal is preferably communicated through delay 1 10 to help 
synchronize camera 102's gating, e.g., to enable camera 102 at or near the Tl point 
(e.g., see FIGS. 29 and 30). Camera 102 can include internal timing source or signal 
(or can communicate with an external timing source or signal) to disable camera at the 
T2 point or beyond. Alternatively, camera 102 is disabled upon watermark detection. 
In an alternative embodiment, the start signal is communicated from illumination 
source 101 to camera 102. Delay 1 10 can be arranged internally in either illumination 
source 101 or camera 102, or can arranged external to these devices. Of course, other 
suitable synchronization techniques can be suitably interchanged with the present 
invention to facilitate gating of camera 102. 

Additional Detection Methods 

[0155] With reference to FIG. 33, a detection housing 20 houses a UV illumination 
source 101 and camera 102 (not shown in FIG. 33, since they are within the opaque 
housing 20). Camera 102 can be a CCD sensor, a CMOS detector, digital camera, web 
camera, etc. The housing 20 is preferably opaque to shield (or otherwise constructed to 
filter) the camera 102 and media 100 from visible, UV and/or IR light. The housing 20 
has an opening 20a to receive the media 100. In a first case, opening 20a is adapted to 
engulf media 100, This allows media 100 to be placed on a surface (e.g., table, 
imaging station, or counter) and the housing opening 20a to be placed over media 100, 
effectively shielding media 100 from visible, UV and/or IR light. In a second case, the 
opening 20a receives media 100 into (e.g., slides media through opening 20a) and 
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positions media 100 within the opaque housing 20. In either case, the UV illumination 
source 101 illuminates media 100, and the camera 102 captures an image of the 
illuminated media (or the emissions from the UV inks used to print media 100). The 
digital camera 102 communicates with computing device 104, which detects and 
decodes a digital watermark embedded with media 100. 

(0156) Now consider an embodiment described with reference to FIGS. 34 and 35. A 
UV pulse 30 excites the inks shown in FIGS. 28a and 28b. At a time TO the inks begin 
to decay. At time Tl the short decay ink (illustrated with a dotted line) is exhausted or 
falls below a predetermined level. A camera detects the inverted watermark signal 
from the long decay ink in the time range of Tl - T2. At a time T2 the UV signal 
(pulse) transitions high 30a. The short (S) and long (L) decay inks are excited and emit 
at the 

S + L level shown in FIG. 35. The watermark signal is effectively masked after the T2 
point due to the cancellation of the non-inverted watermark component by the inverted 
watermark component. 

[01571 Detection of the watermark signal is effectively limited to the Tl - T2 
window in a multiple UV pulse system as shown in FIGS. 34 and 35. Of course the 
10a pulse can remain high or can include a series of UV pulses, which may allow for 
multiple capture windows. The Tl - T2 time window can be optionally varied (time- 
shifted and/or shortened/lengthened) to improve visibility effects and to even further 
reduce detectability. 

[0158] A UV out-of-phase watermark is fragile since an operation (including UV 
steady-state illumination) that combines the K channel with the CMY channel 
effectively cancels the watermark signal. 

[0159] A fragile watermark has utility in many applications. Take counterfeit and 
piracy deterrence, for example. The inventive UV watermark is embedded in original 
CMYK media. If the media is copied, the embedded fragile watermark is either lost or 
degrades predictably, e.g., in part due to the decay-time characteristics of the UV inks. 
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The copy is recognized as a copy (or counterfeit) by the absence or degradation of the 
watermark. Particular camera gating settings also can be established to further frustrate 
would-be counterfeiters. 

[0160] UV out-of-phase watermarks can also be used in conjunction with other 
watermarks, such as robust watermarks. The UV watermark announces a copy or 
counterfeit by its absence or degradation, while the other robust watermark identifies 
author* source, links and/or conveys metadata or other information, etc. In other 
embodiments, a UV out-of-phase watermark is an enabler. For example, some UV out- 
of-phase watermarks may include plural-bit data that is used to enable a machine, allow 
access to a secure computer area, verify authenticity, internet navigation and/or link to 
information. This plural-bit data is lost or sufficiently degrades in a copy, preventing 
the enabling functions. 

Alternative Embodiments 

[01 61] Fluorescent inks are available which fluoresce a visible color emission when 
exposed to an ultra violet (UV) light source (e.g., a black UV light source). Many of 
these inks are invisible when illuminated (or excited) in the visible spectrum. These 
inks are ideally suited for covert applications such as copy control or counterfeit 
detection, since they are generally imperceptible when illuminated in the visible 
spectrum. Such inks are available from Gans Ink and Supply Company in Los Angeles, 
California, USA. 

[0162] Fluorescent inks (which fluoresce a visible color) can be used to print out-of- 
phase watermarks, particularly when they have variable emission decay times. In this 
case, the UV light source illuminates media. The media is printed with at least a first 
UV ink and a second UV ink. The first UV ink includes a relatively shorter decay time 
in comparison to the second UV ink. An out-of-phase digital watermark is embedded 
with signals of the first and second watermark signals. A digital camera or CCD sensor 
captures the visible color emissions (e.g., a visible image) after the first UV ink 
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fluorescence emissions are exhausted (or fall below a predetermined level), but before 
the second UV ink fluorescence emissions are exhausted. 

[01 63] In another embodiment, a digital watermark signal is generated (or provided) 
and the signal is printed with ink having specific excitation and/or emission wavelength 
bands. Illumination and/or detection of the watermark are carried out in the specific 
bands. The digital watermark need not be out-of-phase as discussed herein. Instead, 
the watermark signal is detected by monitoring (or illuminating) the specific 
wavelength bands. The monitoring bands are preferably in either the infrared or 
ultraviolet regions of the spectrum. 

Embedding in Out-of-Ranee Colors 

[01 64] Another inventive fragile watermarking technique embeds watermark data in 
out-of-range colors. A color gamut defines a range of colors. Different color schemes 
(e.g., RGB and CMY) generally include a unique color gamut. Such color schemes 
will most certainly have overlapping color gamuts (or ranges), and unique (or out of 
gamut) color ranges, as shown in FIG. 36. 

[01 65] Differences in gamut between color models can be used to indicate that a 
transformation (or copy) has occurred. Consider security printers, which often select 
inks that lie outside the common color gamuts of capture devices (RGB) when printing 
documents. Printing with such out-of-range (or out of gamut) colors makes 
counterfeiting even more difficult. Consider a document that is printed with some dark 
blues & violets in the CMYK space, which are out of gamut for the RGB space. When 
a scanner scans the CMYK document, it typically converts the scanned image into the 
RGB space. Such processing looses the dark blues and violets in the conversion. An 
educated inspector can identify a counterfeit document by looking for the presence (or 
absence) of certain colors. 
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(0166] The inventive fragile watermark utilizes out-of-range color gamuts. Take the 
example given above. Dark blues & violets in the CMY (or CMYK) space are out of 
gamut with respect to the RGB space. Accordingly, a mask (or color spectral analysis) 
is used to identify dark blues and violets in a media signal. These areas are used (e.g., 
masked) as the areas for embedding watermark signals. The watermark is detectable 
with a CMY detection process. However, if the document is scanned with a RGB 
element scanner, the watennark is generally lost. As discussed above, conversion from 
CMYK to RGB fails to accurately convert out-of-phase colors. In this case, the dark 
blues and violets are out-of-gamut. Accordingly, since the watermark signal is 
embedded in the out-of-gamut colors, it is lost (or predictably degraded) during the 
conversion from CMY to RGB. 

(0167] Consider the possibilities of such a fragile watermark. One can track, trace, 
detect counterfeits, control enabling functions, and many, many more application, like 
those discussed above. 

Conclusion 

[0168] Preferably, an out-of phase watermark signal is embedded in one channel so 
as to be inverted (e.g., 180 degrees out-of-phase) with respect to a corresponding 
channel(s). However, some cancellation will still be achieved if the signal is only 
approximately inverted, for example, in a range of ± 0-50 % from a completely inverted 
signal. The terms "inverted" and "out-of-phase" include values within this range. We 
note that while the present invention has been described with respect to CMYK process 
inks, the present invention is not so limited. Indeed, our inventive techniques can be 
applied to printing processes using more than four inks with the K channel canceling 
the three or more color channels. Similarly, as shown above under the spot color 
discussion, our inventive techniques are also applicable to printing processes using less 
than four inks. Of course our techniques can be used with a variety of printing 
techniques, including offset printing, dye diffusion thermal transfer (D2T2), other 
thermal transfers, process ink printing, etc., etc. 
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10169] It should be appreciated that the order of steps in the FIGS. 4, 19, and 23 flow 
charts can be reordered without deviating from the scope of the present invention. For 
example, in FIG. 4, the K channel could be embedded first, and then the CMY 
channels. Or the K channel could be embedded concurrently with or in between the 
color channels. In FIG. 19, instead of basing the step S22 decision on color saturation, 
the step S22 decision could be based on whether the pixel value is above or below one 
or all of the predetermined thresholds. The color saturation could be analyzed in 
subsequent steps. 

[0170] Also, the signs of the decisions can be reversed, which will respectively 
reverse the decision tree branches, and color ranges. Also, decisions could be based on 
whether a pixel value is less than, or equal to a threshold value. Moreover, instead of a 
maximum pixel value, an average pixel value, or lower pixel value could be used. In 
FIG. 23, the window could alternatively be first vertically repositioned, and then 
horizontally. The window can also be repositioned on a random, or pseudo-random 
basis. The window size may also be varied. 

[0171] The section headings in this application are provided merely for the reader's 
convenience, and provide no substantive limitations. Of course, the disclosure under 
one section heading may be readily combined with the disclosure under another section 
heading. 

[01 72] The above-described methods and functionality can be facilitated with 
computer executable software stored on computer readable media, such as electronic 
memory circuits, RAM, ROM, magnetic media, optical media, memory sticks, hard 
disks, removable media, etc., etc. Such software may be stored and executed on a 
general purpose computer, or on a server for distributed use. Data structures 
representing the various luminance values, out-of-phase embedded signals, embedded 
color planes, color signals, data signals, luminance signals, etc., may also be stored on 
such computer readable media. Also, instead of software, a hardware implementation, 
or a software-hardware implementation can be used. 
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[01 73] In view of the wide variety of embodiments to which the principles and 
features discussed above can be applied, it should be apparent that the detailed 
embodiments are illustrative only and should not be taken as limiting the scope of the 
invention. Rather, we claim as our invention all such modifications as may come 
within the scope and spirit of the following claims and equivalents thereof 

[0174] As mentioned above the use of the term "UV" is used to mean inks that absorb 
in the UV and emit in the UV and/or IR wavelengths. There are also inks that absorb 
in the UV and emit visible wavelengths. Indeed the variable decay-time inks discussed 
herein can emit in a range from visible to UV wavelengths. Also, while "short decay" 
time inks and "long decay" time inks have been described as corresponding to "non- 
inverted" and "inverted" watermark signals, and to CMY channel signals and K 
channel signals, the invention is not so limited. Indeed a short decay ink can be used 
for an inverted signal and a K channel signal. And a long decay ink can be used for a 
non-inverted signal and a CMY channel signal. In addition to the ink application 
methods discussed above, inks and dyes can be application by well-known methods 
such as offset lithography, flexography, and silkscreen, as well as others. In some 
embodiments, these fluorescence varying inks and dyes can also vary in intensity. 
These characteristics can be evaluated for setting various threshold limits (e.g., Tl and 
T3 in FIG. 30). 

[0175] The term "decay" has a broad definition throughout this document including 
the claims. For instance, decay may imply that fluorescence emissions are 
extinguished. Or decay may imply that emissions have fallen below a threshold level 
(e.g., based on detection or interference levels). In some cases, decay implies that 
emissions have begun to decay, such as after a falling edge of a UV pulse. Similarly, 
for this document the term "ink" may include both ink and/or a dye. 
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What is claimed is: 

1 . A method of steganographically hiding a first image in a second image, the 
second image comprising at least a cyan (C) color channel, a magenta (M) color 
channel, a yellow (Y) color channel and a black (K) color channel, said method 
comprising the steps of: 

providing a first set of signal modifications corresponding to the first image; 
modifying the K color channel of the second image with the first set of signal 
modifications; 

providing a second set of signal modification corresponding to the first image, 
the second set of signal modifications being inverted with respect to the first set of 
signal modifications; and 

modifying the C, M and Y color channels of the second image with the second 
set of signal modifications, wherein the location of the modifications of the K color 
channel and the CMY modifications in the second image correspond. 

2. The method of claim 1, further comprising providing a print of the second 
image once the first image has been hidden therein, and wherein the CMY color 
channel modifications are inverted with respect to the K channel modifications so as to 
reduce the first image's visibility in the print by canceling perceived luminance change 
in local areas throughout the print. 

3. The method of claim 1, wherein the first image comprises at least one of a 
photograph, bar code, text, an orientation reference for at least one of the first and 
second image, and a digital watermark. 

4. The method of claim 3, wherein the first image is redundantly embedded 
throughout the second image. 
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5. A method of embedding a digital watermark component in a signal having a 
plurality of channels, said method comprising the steps of: 

embedding the digital watermark component in a first of the plurality of 
channels; and 

embedding the digital watermark component in a second of the plurality of 
channels to be out-of-phase with respect to the digital watermark component in the first 
channel. 

6. The method according to claim 5, wherein embedding the digital watermark 
component in a second of the plurality of channels to be out-of-phase with respect to 
the digital watermark component in the first channel cancels a perceived luminance 
change in local areas throughout the signal. 

7. A method of hiding a first image in a second image comprising: 
converting the first image to a black channel image; 

selecting a location in the second image to hide the black channel image; 

modifying the black channel in the selected location to accommodate the 
black channel image; 

providing in terms of at least cyan, magenta and yellow channels a color 
channel image that is inverted with respect to the black channel image; 

modifying the cyan, magenta and yellow channels in the selected location to 
accommodate the color channel image. 

8. The method of claim 7, wherein the effect of inverting the color channel 
image with respect to the black color image is to cancel luminance changes in local 
areas throughout the selected area. 

9. A method of steganographically embedding a bar code in an image, the 
image 

including at least a black channel and at least a color channel, said method comprising 
the steps of: 
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converting the barcode into a set of grayscale values; 

in at least one region of the image, modifying the black channel in the region to 
accommodate the set of grayscale values; 

inverting the grayscale values in the set; and 

modifying the color channel in the region to accommodate the inverted 
grayscale values in a manner so that the modified black channel region is inverted with 
respect to the modified color channel. 

10. The method of claim 9, wherein the color channel comprises a spot color, 

1 1. The method of claim 9, wherein the color channel comprises at least a cyan 
channel, a magenta channel and a yellow channel. 

12. The method of claim 11, wherein said modifying the color channel in the 
region modifies each of the cyan, magenta and yellow channels to accommodate the 
inverted grayscale values. 

13. The method of claim 12, modifying the black channel region to be inverted 
with respect to the modified color channel effectively cancels a luminance change in 
the region. 

14. A method of embedding a digital watermark component in a signal having 
a plurality of channels, said method comprising the steps of: 

embedding the digital watermark component in a first of the plurality of 
channels; and 

embedding the digital watermark component in a second of the plurality of 
channels to be out-of-phase with respect to the digital watermark component in the first 
channel. 

15. The method according to claim 14, wherein the plurality of channels 
comprises color channels and at least one black channel. 
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16. The method according to claim 15, wherein the color channels comprise 
cyan, magenta and yellow. 

1 7. The method according to claim 16, further comprising the steps of 
embedding the digital watermark component in at least a third channel and a fourth 
channel. 

1 8. The method according to claim 17, wherein the first channel, third channel 
and fourth channel respectively comprise the cyan, magenta and yellow, and the second 
channel comprises black. 

19. The method according to claim 18, wherein the digital watermark 
component in the second channel is embedded approximately 180 degrees out-of-phase 
with respect to the digital watermark component in the first channel. 

20. The method according to claim 14, wherein the digital watermark 
component in the second channel is embedded approximately 180 degrees out-of-phase 
with respect to the digital watermark component in the first channel. 

21. A method of embedding a media signal with a digital watermark signal, the 
media signal comprising a first color plane, a second color plane, a third color plane, 
and a fourth color plane, said method comprising the steps of: 

combining the watermark signal with the first color plane, second color plane 
and third co lor plane; 

inverting the digital watermark signal; and 

combining the inverted digital watermark signal with the fourth color plane. 

22. A method of generating a fragile watermark comprising the steps of: 
embedding a digital watermark signal in at least a first color plane; and 
embedding the digital watermark signal in a second color plane to be out-of- 
phase with respect to the digital watermark signal in the first color plane, the locations 
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of the first color plane embedding and the second color plane embedding being in 
relative alignment. 

23. The method according to claim 22, further comprising the steps of: 
embedding the digital watermark signal in a third color plane; and 
embedding the digital watermark signal in a fourth color plane. 

24. The method according to claim 23, wherein the first color plane, third color 
plane and fourth color plane respectively comprise the cyan, magenta and yellow, and 
the second color plane comprises black. 

25. The method according to claim 22, wherein the digital watermark in the 
second color plane is inverted with respect to the digital watermark in the first color 
plane. 

26. A method of conditioning a signal including an out-of-phase embedded 
watermark for watermark detection, the out-of-phase embedded watermark being 
embedded in a media signal comprising a plurality of color channels, said method 
comprising the steps of: 

determining a luminance value per pixel for a first set of the plurality of color 

channels; 

determining a luminance value per pixel for a second set of the plurality of color 
channels; and 

subtracting the second set's luminance value from the first set's luminance 

value. 

27. The method according to claim 26, wherein the watermark is embedded in a 
first, second and third channel of the plurality of channels, and is embedded to be out- 
of-phase with the first, second and third channels in a fourth channel. 
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28. A method to condition a signal for recovery of an out-of-phase digital 
watermark which is embedded in a media signal in a first color scheme, the media 
signal being subsequently converted to a second color scheme, said method comprising 
the steps of: 

designating each pixel in the converted media signal as at least either a first 
color, a second color or a third color; 

creating a first color plane and a second color plane based on color designations 
in said designating step; 

determining a luminance value per area for each of the first color plane and 
second color plane; and 

on an area by area basis, subtracting the second area's luminance value from the 
first area's luminance value. 

29. The method according to claim 28, wherein said designating step 
comprising the step of: 

determining a designation at least in part by pixel color saturation; and 
determining the designation at least in part by pixel value. 

30. The method according to claim 28, wherein the first color scheme 
comprises a CMYK color scheme and the second color scheme comprises an RGB 
color scheme. 

3 1 . A method of assigning a pixel value to a first set or to a second set 
comprising the steps of: 

a first step of determining the color saturation of the pixel and comparing the 
pixel's color saturation to a first predetermined value; and 

a second step of determining a pixel value for the pixel and comparing the 
pixel's pixel value to a second predetermined value, wherein assignment of the pixel to 
either the first and second sets is based on the comparison in the first determining step 
and the second determining step. 



BNSOOCID: <WO 03005291A1 J_> 



WO 03/005291 



PCT/US02/20832 



-53- 

32. A computer readable medium having computer executable instructions 
stored thereon, the instructions comprising instructions to embed a media signal with a 
digital watermark, the media signal including a plurality of color channels, the 
instructions to embed the media signal with a digital watermark component in at least a 
first of the plurality of channels, and to embed the digital watermark component a 
second of the plurality of channels to be approximately inverted with respect to the 
digital watermark component in the first channel. 

33. The computer readable medium according to claim 32, wherein the digital 
watermark signal component is embedded in a second channel and a third channel of 
the plurality of channels. 

34. A method of hiding data in a media signal having a plurality of colors in a 
first color space comprising the steps of: 

determining in the first color space at least a first color which is out of color 
gamut in a second color space; and 

embedding a watermark component in the first color. 

35. The method according to claim 34, wherein the media signal comprises at 
least one of an image and video signal. 

36. The method according to claim 34, wherein the first color is one of dark 
blue and violet. 

37 A printing method comprising the steps of: 

printing on a surface a first digital watermark component with a first ink having 
a first emission decay time; and 

printing on the surface a second digital watermark component with a second ink 
having a second emission decay time. 
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38. The method according to claim 37, wherein the first digital watermark 
component is out-of-phase with respect to the second digital watermark component. 

39. The method according to claim 37, wherein the second digital watermark 
component is inverted with respect to the first digital watermark component. 

40. The method according to claim 38, wherein the second emission decay time 
is longer than the first emission decay time. 

41 . The method according to claim 40, wherein the first ink and the second ink 
emit in the ultraviolet spectrum. 

42. The method according to claim 40, wherein the first ink and the second ink 
emit in the infrared spectrum. 

43. The method according to claim 40, wherein the first ink and the second ink 
emit visible light when excited with ultraviolet light. 

44. The method according to claim 43, wherein the ultraviolet light comprises 
black ultraviolet light. 

45. The method according to claim 40, further comprising the step of shielding 
the surface from visible light. 

46. The method according to claim 40, further comprising the step of filtering 
visible light. 

47. The method according to claim 40, wherein the first ink is printed with a 
first plate and the second ink is printed with a second plate. 
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48. The method according to claim 40, wherein the first ink prints the first 
digital watermark component in a cyan, magenta and yellow channel and the second 
ink prints the second digital watermark component in a black channel. 

49. The method according to claim 40, wherein the first emission decay time 
and the second emission decay time each comprise at least one of emission exhaustion 
and emissions falling below a threshold level. 

50. A method to detect a digital watermark embedded in media, the digital 
watermark comprising a first component printed with a first ink and a second 
component printed with a second ink, the second ink comprising an emission decay 
time that is longer than an emission decay time of the first ink, said method comprising 
the steps of: 

exciting the first ink and the second ink; and 

detecting the digital watermark after emissions from the first ink fall to a first 
predetermined level and before emissions from the second ink fall to a second 
predetermined level. 

51. The method according to claim 50, wherein the digital watermark 
comprises an out-of-phase digital watermark. 

52. The method according to claim 50, wherein the first ink and second ink 
each emit in the ultraviolet spectrum. 

53. The method according to claim 50 wherein the first ink and second ink emit 
each in the infrared spectrum. 

54. The method according to claim 50, wherein the first ink and the second ink 
each emit visible light when excited with ultraviolet light. 
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55. The method according to claim 50, wherein said detecting step comprises 
gating a camera to capture emissions from the second ink after emissions from the first 
ink fall to a first predetermined level and before emissions from the second ink fall to a 
second predetermined level. 

56. The method according to claim 50, wherein said exciting step comprises 
pulsing an illumination source. 

57. The method according to claim 56, further comprising a second step of 
exiting the first ink and the second ink after emissions from the first ink fall to the first 
predetermined level and before emissions from the second ink fall to the second 
predetermined level. 

58. The method according to claim 57, wherein said second exciting step 
comprises pulsing the illumination source. 

59. A document comprising a digital watermark embedded thereon, said digital 
watermark comprising: 

a first component applied with a first ink comprising a first emission decay 
time; and 

a second component applied with a second ink comprising a second emission 
decay time. 

60. The document according to claim 59, wherein the first component is 
inverted with respect to the second component. 

61. The method according to claim 60, wherein the second emission decay time 
is longer than the first emission decay time. 
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62. The method according to claim 61, wherein the document comprises at 
least one of a certificate, paper, label, tag, product packaging, thin films, identification 
card, bank note, treasury bond, cardboard, metal foil, fabric, property title, plastic, 
metal insurance receipt, contract and trading card. 

63. The method according to claim 61, wherein the first emission decay time 
and the second emission decay time comprise at least one of emission exhaustion and 
emissions falling below a threshold level. 

64. A digital watermarking method comprising the steps of: 

embedding a first digital watermark component in at least a first color channel; 

embedding a second digital watermark component in at least a second color 
channel, the second digital watermark component embedded to be inverted with respect 
to the first digital watermark component; 

printing on a surface the first color channel with a first ink comprising a first 
emission decay time; and 

printing on the surface the second color channel with a second ink comprising a 
second emission decay time. 

65. The method according to claim 64, wherein the first color channel 
comprises 

a cyan channel, a magenta channel and a yellow channel and the first ink comprises a 
cyan, magenta and yellow ink, and wherein the second color channel comprises a black 
channel and the second ink comprises a black ink. 

66. The method according to claim 65, wherein the second decay time is longer 
than the first decay time. 

67. The method according to claim 66, wherein the first decay time is longer 
than the second decay time. 
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68. A method comprising: 
providing a digital watermark signal; and 

printing on a surface the digital watermark signal with an ink comprising a 
fluorescence emission wavelength range, the ink further comprising a limited emission 
decay time. 

69. A method of steganographically hiding a first image in a second image, the 
second image comprising a plurality of color channels, wherein the hiding of the first 
image in the second image comprises at least hiding a first image component in a first 
of the plurality of color channels, and, at the same second image location, hiding the 
component in a second of the plurality of channels, the second channel component 
being inverted with respect to the first channel component, said method comprising the 
steps of: 

analyzing an attribute of at least one of the plurality of color channels; and 
based on the analysis, altering the first image component prior to embedding in 
the first and second color channels. 

70. The method of claim 69, wherein the attribute comprises luminance. 

71 . The method of claim 70, wherein the at least one of the plurality of color 
channels comprises a yellow color channel. 

72. The method of claim 70, wherein the altering comprises scaling back the 
signal strength of at least one of the first channel component and the second channel ' 
component when the luminance equals or exceeds a predetermined threshold. 

73. The method of claim 71, wherein the attribute comprises color saturation. 

74. The method of claim 70 , wherein the altering comprises scaling back the 
signal strength of at least one of the first channel component and the second channel 
component when the color saturation equals or exceeds a predetermined threshold. 
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75. The method of claim 74, wherein the scaling comprises linear scaling. 

76. A method of steganographically hiding a digital watermark in an image, the 
image comprising a plurality of color channels including a black channel and a first 
color channel, said method comprising the steps of: 

segmenting the image into a plurality of blocks; 

hiding a first digital watermark component in the black channel of a first of the 
plurality of blocks; 

hiding the component in the first color channel of the first block, the first 
channel component being inverted with respect to the black channel component; 

detecting the digital watermark component; and 

based on the digital watermark detection, reembedding the first block if the 
detection is below a predetermined threshold* and embedding a second of the plurality 
of blocks if the detection is above a predetermined threshold. 

77. The method of claim 76 wherein the predetermined threshold comprises at 
least one of a predetermined level, an error level, and a successful detection of the 
digital watermark component. 

78. The method of claim 76, wherein the plurality of channels comprises cyan 
(C), magenta (M), and yellow (Y), and wherein the first color channel comprises the Y 
channel, and wherein said method further comprises hiding the component in the first 
block in the C and M channels, the C and M channel components each being inverted 
with respect to the black channel component. 

79. A method of monitoring a printing process, the printing process providing a 
print having at least a first color plane and a second color plane, wherein a digital 
watermark is steganographically embedded in the print by embedding at least one 
digital watermark component in the first color plane and, at the same print location, 
embedding the component in the second plane, the second plane component being 
inverted with respect to the first plane component, said method comprising the steps of: 
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capturing a visible spectrum image of the print to provide corresponding scan 

data; 

analyzing scan data to detect the digital watermark component; and 
signaling at least a printing misalignment when the digital watermark 
component is detected. 

80. The method of claim 79, wherein the first color plane comprises a black 
color 

plane, the second color plane comprises yellow, and wherein the print further comprises 
a cyan color plane and a magenta color plane, and at the same print location as the 
black color plane component and the yellow color plane component, embedding the 
component in the cyan and magenta planes, the cyan and magenta plane components 
being inverted with respect to the black plane component. 

81 . A method to detect a first image hidden in a second image, the 

second image comprising a plurality of color channels, wherein the hiding of the first 
image in the second image comprises at least hiding a first image component in a first 
of the plurality of color channels, and in the same second image location, hiding the 
component in a second of the plurality of channels, the second channel component 
being inverted with respect to the first channel component, said method comprising the 
steps of: 

illuminating the embedded second image with infrared light; 
capturing a digital image of the illuminated second image; and 
analyzing the captured illuminated digital image to detect the first image. 

82. The method according to claim 81, wherein the first image comprises at 
least one of a photograph, graphic, logo, barcode, digital watermark, image, text, 
message and orientation fiducial. 

83. The method according to claim 82, wherein the first color channel 
comprises black, and the second color channel comprises cyan, magenta and yellow 
channels, wherein the second channel component is embedded in each of the cyan, 



BNSDOCID: <WO 



03006291 A 1 \> 



WO 03/005291 



PCT/US02/20832 



-61- 

magenta and yellow components, the second channel component being inverted in each 
of the cyan, magenta and yellow channels with respect to the first channel component. 

84. The method according to claim 82, wherein the first color channel 
comprises black and the second color channel comprises cyan, magenta and yellow 
channels. 

85. The method according to claim 84, wherein at least said black color channel 
conforms to standard web offset press (SWOP) standards. 

86. The method according to claim 81, further comprising the step of shielding 
the media from visible light. 

87. The method according to claim 81, further comprising the step of filtering 
visible light before said step of capturing a digital image. 

88. The method according to claim 82, wherein the first color channel 
comprises black, and the second color channel comprises a spot color. 

89. The method of claim 82, wherein the inverted nature of the second channel 
component with respect to the first channel component cancels localized luminance 
attributable to the hiding of the first channel component. 

90. A method to detect a digital watermark embedded in media, wherein the 
media includes a plurality of color planes and the digital watermark includes at least a 
first component and a second component, wherein the second component is embedded 
in a second color plane at a first media location so as to be inverted in the same media 
location with respect to the first component embedded in a first color plane so as to 
cancel luminance attributable to the first component, said method comprising the steps 
of illuminating the media with infrared light or ultraviolet light, and detecting the 
digital watermark from the illuminated media. 
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91. A method to detect a digital watermark embedded in at least a first of a 
plurality of color planes, and embedded in a second color plane in an inverted manner 
with respect to the first plane, said method comprising the steps of: 

isolating the first color plane from the plurality of color planes; and 
analyzing the isolated color plane to detect the embedded digital watermark. 

92. The method according to claim 12, wherein said isolating step comprises 
the step of illuminating the plurality of color planes with infrared light. 

93. The method according to claim 91, wherein said isolating step comprises 
the step of illuminating the plurality of color planes with ultraviolet light. 

94. A method of detecting an orientation fiducial steganographically hidden 
in a second image to help resolve image distortion, the second image comprising a 
plurality of color channels, wherein the hiding of the orientation fiducial in the second 
image comprises hiding the fiducial in a first of the plurality of color channels, and 
hiding the fiducial in a second of the plurality of channels at the same location as the 
hidden first channel fiducial, the second channel fiducial being inverted with respect to 
the first channel fiducial so as to cancel localized luminance attributable to the first 
channel fiducial, said method comprising the steps of illuminating the second image 
with infrared light, capturing a digital image of the illuminated second image, and 
analyzing the captured illuminated digital image to detect the fiducial. 

95. The method of claim 94, wherein the fiducial comprises an indication of an 
original scale and orientation of at least one of the orientation fiducial and second 
image. 

96. The method of claim 95, further comprising the step of comparing the 
orientation and scale of the detected fiducial to an expected orientation and scale to 
rescale and reorient the second image. 



BNSDOCIO: <W Q 0300529 1A1 I > 



WO 03/005291 



PCT/US02/20832 



1/21 




FIG. 1 




FIG. 2 



03005291A1 L> 



WO 03/005291 



PCT/US02/20832 



2/21 



FIG. 3a 

C 

M, Y 

K 



FIG. 3b 



c n [j-^n^i ^ ri f.n. 

m, y ...XL.. xr ....q J .n. ri: [i..-.. t;) J^j-jm- 
K ... Tr ..Jx.... r p. a .rq ;j .....D T p-..q :r . 0 . 



BNSDOCID: <WO 03005291 A 1„l_> 



WO 03/005291 



PCT/US02/20832 



3/21 

FIG. 4 



Generate 


Watermark 


Signal 




r 




Embed 






Watermark 






Signal in 






CMY 






Channels 






r 




Generate 






Inverse 






Watermark 






Signal 






f 




Embed 






Inverse 






Watermark 






Signal in K 






Channel 





S1 



S2 



S3 



FIG. 5 















! ► 





BNSOOCID: <WO 03005291 At I » 



WO 03/005291 



PCT/US02/20832 



4/21 

FIG. 6 



Convert Image to a 
Black Channel Image [ — S30 



Select a Location in the 
Media to Hide the Black 
Channel Image 



i 



Modify the Black 
Channel in the Selected 

Location to 
Accommodate the Black 

Channel Image 



Provide Color Image in 
Terms of CMY Tweaks, 
which are Inverted with 
Respect to the Black 
Channel Image 



S32 



S34 



S36 



Modify CMY Pixels in 
the Channels of the 
Selected Location with 
the CMY Tweaks 



S38 



BNSDOCID; <WO 0300 5291 A 1 I > 



WO 03/005291 



PCT/US02/20832 



5/21 



FIG. 7 



Hidden 
Signal Strength 



90% 



7-V (White) 



Luminance 



FIG. 8 



Hidden 
Signal Strength 




(White) 



90% 



Luminance 



BNSDOCID: <WO 03005291A1 _l_> 



WO 03/005291 



PCT/US02/20832 



6/21 



FIG. 9 



Hidden 
Signal Strength 



80% 



(100% 

Saturation) 



Color Saturation 



FIG. 10 



Hidden 
Signal Strength 




80% 



(100% 
Saturation) 



Color Saturation 



BNSDOCiD:<WO 03005291A1.I > 



WO 03/005291 



PCT/US02/20832 



7/21 



K Channel 
Tweak Level 



Cap level 



CMY 
Tweak Level 



CMY Lower 
Limit 



Cap level 



FIG. 11 



Determine a 
Luminance 
Value from C, 
M, and Y 
Channels 



Resulting 

Lum CMY 

Value 



FIG. 16 



Determine a 
Luminance 
Value from 
the K Channel 



Resulting 
Lum K Value 



FIG. 17 



BNSDOCID: <WO 0300 5291 A 1 l_> 



WO 03/005291 



PCT/US02/20832 



8/21 



FIG. 12 



1 


2 


• • • 




























• * ■ 


n 



12 



Media 



BNSOOCJD: <WO O3OO5201A1.L> 



FIG. 13 



Image or Watermark 
Signal 



Embedding 



Embedded 
Media 




WO 03/005291 



PCT/US02/20832 



9/21 



FIG. 14 



110 

Embed i lh Block with K 
Channel Watermark 
Signal 



122' 



Increase 

WM 
Strength 



Invert Watermark Signal , 112 



i = i + 1 



120 



Embed Inverted 
Watermark Signal in 
CMY Channels 



114 



Detect Digital 
Watermark 



116 



No 




BNSOOCIO <WO 03005291 A 1.l_> 



WO 03/005291 



PCT7US02/20832 





WO 03/005291 



PCT/US02/20832 



11/21 

FIG. 18 



Determine 




CMY and K 




! Luminance 




Values 










Subtract 






Lum K 


from 






Lum CMY to 






Determine 






Lun 


1 final 





Analyze 




Lum final to 




Detect 




Watermark 




Signal 





S12 



Measured RGB 
Value 







wmrra 


i \ 

Ro, G 0i Bo v 






Jerfack ^ 





FIG. 20 



BNSDOCID: <WO 03005291 A 1,.L» 



WO 03/005291 



PCT/US02/20832 



12/21 



Determine a Color 
Saturation Value 
(ColSat) for an RGB 
Pixel 



Yes 



S24 



No 



No 




S20 



S22 




No 



Yes 




S34 



Designate 
RGB Pixel 
as Black 




Yes 



S26 



Yes 



1 






Designate 
RGB Pixel 
as Color 



No 









Designate 




RGB Pixel 




as Color 



Designate 
RGB Pixel 
as White 



S38 



S30 



Designate 
RGB Pixel 
as White 



S32 



FIG. 19 



BNSDOC1D: <WO 0300629 1A1J_> 



WO 03/005291 



PCT/US02/20832 



13/21 

FIG. 21 



T, 



*CMY 



.255 



White 



FIG. 22 



255 



White 





156 


r 




WM 




Detector 


< ! 




154 




^ , 152 



FIG. 26 



BNSDOCia <WO 03005291A1 J„» 



WO 03/005291 



PCT/US02/208J2 



14/21 



S40 



S44 



No 



Sum Luminance 
Values Within 
Window 



^ End 



Yes 



S50 



Horizontally 
Reposition Window 



S42 



Sum Luminance 
Values Within 
Window 




Vertically 
Reposition 
Window 



S46 



S48 



FIG. 23 



BNSDOCID: <WO_ 



_0300S291A1J..» 



WO 03/005291 



PCT/US02/20832 



15/21 



FIG. 24 




Spot Color 
Max Intensity 



FIG. 25 




Spot Color 
Tweak 



K Channel 
Base Level 




K Channel 
Tweak 



BNSDOCID: <WO 03005291A1 J_> 



WO 03/005291 



16/21 



PCT/US02/20832 



FIG. 27 



Base- 
line 



Short 
decay 

Long 
decay 



jx.^^E b .n TE pi_.. u x t| .. t p..n. 
. xr ..Jx..._p. n .rn tl .....n T p...q J . a . 



FIG. 28a FIG. 28b 



Intensity 




(ms) (ms) 



BNSDOCIO: <WO 0300529 1A1.L> 



WO 03/005291 



PCT/US02/20832 



17/21 



FIG. 29 











► 















TO T1 T2 T3 



FIG. 30 



Intensity 



BNS0OCtD;<WO 03005291 A 1_l_> 




WO 03/005291 PCT/US02/20832 

18/21 

FIG. 31 

C 

M, Y 
K 



..:n.. tJ .....c b .o. tr ri..... u .r t .,. D Q.n. 
... Tr ..jx.... c p D .x^ J .....n x p-..r| :i .. a . 




RN-Snonm <WO O30O520tA1 I > 



WO 03/005291 



PCT/US02/20832 




WO 03/005291 



PCT/US02/20832 



20/21 

FIG. 34 



30 . 








► 

















TO T1 T2 T3 



FIG. 35 

S + L 



Intensity 




Time (ms) 



BNSDOCIO:<WO 030O5291A1 I > 



WO 03/005291 PCT/US02/20832 

21/21 



R 




Out of Gamut q 

Color, with 
respect to RGB 



FIG. 36 



BNSDOCID: <WO. 



.03005291A1 l.> 



INTERNATIONAL SEARCH REPORT 



International app] 
PCT/US02/2O832 



No. 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC(7) : G06K 9/00 

USCL : 382/100 
According to Internaii ""*! Pute m Classification (IPC) or to boih np rinrtnJ g |« <ification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 
U.S. : 382/100, 382/232; 380/54 



Documentation searched other than minimum documentation to the extent that such documents arc included in the fields searched 
NONE 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 
Please See Continuation Sheet 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category i 



Citation of document, with indkatoon, where appropriate, of the relevant passages 



Relevant to claim No. 



Y 
Y 
A 
A 



US 5,893, 101 A (BALOGH et al.) 06 April 1999, col. J 1, lines 5-60. 
US 5.946,414 A (CASS et al.) 31 August 1999, column 9. lines 4-4S5. 
US 5,568,555 A (SHAMIR) 22 October 1996, column 20, lines 1-65. 
US 5,291 ,243 A (HECKMAN et al.) 01 March 1994, column 8, lines 4-63. 



1-4 
1-4 
1-4 
1-4 



□ 



Further documents are listed in the continuation of Box C. 



□ 



See patent family annex. 



"A" document defining the general cute of the an which ii not 
of particular relevance 

*8* earlier application or patent polluted on or after the tntcroatUnal Tiling date 

"L" document which may throw doubts on priority claim(a) or which u died to 
establish the publication date of anaber citation or other special reason (at 
specified) 



later document published after the intersational filing date 
date and not in conflict with the application hut died to understand the 
principle or theory underlying the bvtntion 



referring to an oral disclosure, use. exhibition or other a 



t he considered to Involve an inventive step 



document of particular relevance; the claimed invention cannot be 
considered in involve an inventive step when the 
combined with ate or mare ether such documents, 
being obvious to a person skilled in the art 



•P" documrra published prior to the ioicmatiaul filing date but later than the 
priority date claimed 




Date of the actual completion of the international search 
05 August 2002 (05.08.2002) 



Date of mail 



Authorized officer 
Jayanu K. Pate! 
Telephone No 



Name and mailing address of the ISA/US 
Commissioner of Patents and Trademarks 
BoxPCT 

Washington, D.C. 20231 
Facsimile No. (703)305-3230 



Form PCT/ISA/210 (second sheet) (July 1998) 



BNSOOCID: <WO 03006291 A 1 I > 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCT/USO2/20832 



Box 1 Observations where certain claims were found unsearchable (Continuation of Item 1 of first sheet) 



This international report has not been established in respect of certain claims under Article 17(2)(a) for the following reasons: 



□ 



i. □ 



□ 

6.4(a). 



Claim Nos.: 

because they relate to subject matter not required to be searched by this Authority, namely: 



Claim Nos. : 

because they relate to parts of the international application (hat do not comply with the prescribed requirements to 
such an extent that no meaningful international search can be carried out, specifically: 



Claim Nos.: 

because they are dependent claims and are not drafted in accordance with the second and third sentences of Rule 



Box D Observations where unity of invention is lacking (Continuation of Item 2 of first sheet) 



This International Searching Authority found multiple inventions in this international application, as follows: 
Please See Continuation Sheet 



1 - I 1 As all required additional search fees were timely paid by the applicant, this international search report covers all 
searchable claims. 

2. 1 1 As all searchable claims could be searched without effort justifying an additional fee, this Authority did not invite 

payment of any additional fee. 

3. | 1 As only some of the required additional search fees vwre timely paid by the applicant, this international search 

report covers only those claims for which fees were paid, specifically claims Nos.: 



4. |^j No required additional search fees were timely paid by the applicant. Consequently, this international search report 
is restricted to the invention first mentioned in the claims; it is covered by claims Nos.: 1-4 

Remark on Protest ^] The additional search fees were accompanied by the applicant's protest. 

| No protest accompanied the payment of additional search fees. 



ForraPCT/ISAA2lO (continuation of first sheet( I )) (July 1998) 



BNSDOCID: <WO 0300529 1A1 J. > 



INTERNATIONAL SEARCH REPORT 



PCl7US02/20832 



BOX BL OBSERVATIONS WHERE UNITY OF INVENTION IS LACKING 

The; application contains (he following inventions or groups which are not so linked as to form a single inventive concept under PCT 
Rule 13. 1. In order for all inventions to be searched, the appropriate additional search fees must be paid. 

I Claims 1-4 are drawn to a method of steganographically hiding a fust image in a second image comprising cyan, magenta, 

yellow and black color channel. 

II . Claims 5-6 are drawn to a method of embedding a digital watermark component having a plurality of channels. 

III . Claims 7-8 are drawn to a method of hiding a first image in a second image by converting the first image to Mack channel . 

IV . Claims 9- 13, 92 are drawn to a method of steganographically embedding a bar code in an image. 

V. Claims 14-20 are drawn to a method of embedding a digital watermark component in a signal having a plurality of channels. 

VI. Claim 21 is drawn to a method of embedding a media signal with a digital watermark. 

VII. Claims 22-25 are drawn to a method of generating a fragile watermark in a first and second color plane. 

VIII. Claims 26-27 are drawn to a method of conditioning a signal including an out-of -phase embedded watermark. 

IX. Claims 28-30 are drawn to a method of conditioning a signal for recovery of an mu-of-phase digital watermark signal. 

X. Claim 31 is drawn to a method of assigning a pixel value to a first and second set. 

XI . Claims 32-33 are drawn to a computer readable medium having computer executable instructions. 

XII. Claims 34-36 are drawn to a method of biding data in a media signal having a plurality of colors. 

XIII. Claims 37-49 are drawn to a method of printing on a surface a first and a second digital watermark. 
XIX Claims 50-58 are drawn to a method to detect a digital watermark embedded in a media. 

XX. Claims 59-63 are drawn to a document comprising a digital watermark comprising a first component applied with a first ink 
and second component applied with a second ink. 



XXI. Claims 64-67 are drawn to a digital watermarking method comprising the steps of embedding a first and a second digital 
watermark in a first and a second color. 

XXII. Claim 68 is drawn to a method of providing a digital watermark with fluorescence ink. 

XXIII. Claims 69-78 are drawn to a method of steganographically hiding a first image in a second image comprising a plurality of 
color channels. 

XXIV. Claims 79-80 are drawn to a method of monitoring printing process. 

XXV. Claims 81-89 are drawn to a method to detect a first image hidden in a second image comprising a plurality of color 
channels. 

XXVI. Claim 90 is drawn to a method to detect a digital watermark embedded in media, including a plurality of color planes and 
ultraviolet and infrared lights. 

XXVTl. Claims 91 and 93 are drawn to a method to detect digital watermark embedded in a first and second color plane in an 
inverted manner. 

XXV11I. Claims 94-96 are drawn to a method of detecting an orientation fiducial steganographically bidden in a second image. 

The special technical features of Group I inventions is a method of steganographically hiding a first image in a second image 
comprising cyan, magenta, yellow and black channel. 

The special technical feature of Group 11 is method of embedding a digital watermark component having a plurality of 

channels. 

The special technical feature of Group III is a method of biding a first image in a second image by converting the first image to black 
channel. 

The special technical feature of Group IV is a method of steganographically embedding a bar code in an image. 

The special technical feature of Group V is a method of embedding a digital watermark component in a signal having a plurality of 

c hanne ls 

The special technical feature of Group VI is a method of embedding a media signal with a digital watermark. 

The special technical feature of Group VII is a method of generating a fragile watermark in a first and second color plane. 

The special technical feature of Group VIII is a method of conditioning a signal including an out- of- phase embedded watermark. 

The special technical feature of Group IX is a method of conditioning a signal for recovery of an out-of-phase digital watermark 

signal. 

The special technical feature of Group X is a method of assigning a pixel value to a first and second set. 

The special technical feature of Group XI is a computer readable medium having computer executable instructions. 

The special technical feature of Group XII is a method of hiding data in a media signal having a plurality of colors. 
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The special technical feature of Group XJH is a method or printing on a surface a first and a second digital watermark. 
The special technical feature of Group XIX is a method to detect a digital watermark embedded in a media. 

The special technical feature of Group XX is a document comprising a digital watermark comprising a first component applied with a 
first ink and second component applied with a second ink. 

The special technical feature of Group XXI is a digital watermarking method comprising the steps of embedding a first and a second 
digital watermark in a first and a second color. 

The special technical feature of Group XXII is a method of providing a digital watermark with fluorescence ink. 

The special technical feature of Group XXTII is a method of stcganographically hiding a first image in a second image comprising a 

plurality of color channels. 

The special technical feature of Group XXIV is a method of monitoring printing process. 

The special technical feature of Group XXV is a method to detect a first image hidden in a second image comprising a plurality of 
color channels. 

The special technical feature of Group XXVI is a method to detect a digital watermark embedded in media, including a plurality of 
color planes and ultraviolet and infrared lights. 

The special technical feature of Group XXVII is a method to detect digital watermark embedded in a first and second color plane in 
an inverted manner. 

The special technical feature of Group XXVIII is a method of detecting an orientation fiducial steganographically hidden in a second 
image. 
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